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INTRODUCTION 



| Congress has a longstanding interest in data describing the status of secondary 

and postsecondary vocational education programs. Basic questions about the vocational 

■ education enterprise — how it is organized and governed, what if offered, who 
participates, what is accomplished, and what it costs — have dominated policy discussions 

fl at the local, state, and federal levels during the past thirty years. Accurate answers to 

these questions, however, have been difficult to obtain. Producing good national data on 

■ vocational education is an ongoing challenge. 

m On several occasions, therefore. Congress has asked for better data on vocational 

g education. Most recently, in the Carl D. Perkins Vocational and Applied Technology 

Education Act of 1990, Congress directed the Secretary of Education to establish a 

■ vocational education data system that, to the extent practicable, would use comparable 
information elements and uniform definitions to describe the condition of secondary and 

m postsecondary vocational education. Generally, this system should support the overall 

purpose of federal vocational education policy: "improving educational programs leading 

■ to academic and occupational skill competencies needed to work in a technologically 
™ advanced society" (Section 2). Specifically, this system is to serve two primary 
_ functions: (1) provide Congress with information relevant to policymaking and (2) 
| provide local, state, and federal agencies, as well as tribal agencies, with information 

relevant to program management, administration, and effectiveness of vocational 
I education. 

I Additionally, Congress sought a system that would describe the major elements of 

the vocational education enterprise, including students, teachers, administrators, facilities, 

■ and equipment. This system should include information on the participation of members 
• of special populations. At a minimum, such a system should produce national estimates 
m and do so in the context of the larger secondary and postsecondary education systems. 

In calling for a vocational education data "system," Congress was clear about its 
g not expecting a new, independent system of collection that would be unique to vocational 

education. On the contrary, the law explicitly stated that the system should use, or 

■ modify as necessary, existing data collection systems operated by the U.S. Department of 
Education and other federal agencies. The law provided for collection of new data where 
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necessary, but it clearly stated that any new efforts should complement existing systems. 
Further, Congress asked that the Department of Education update the system at least 
every three years. 

How might these requirements of the 1990 Perkins Act be satisfied? To answer 
that question, the Office of Vocational and Adult Education (OVAE) and the National 
Center for Education Statistics (NCES) contracted with the National Center for Research 
in Vocational Education (NCRVE) at the University of California at Berkeley to conduct 
a study of national data needs for vocational education. The study had as its primary 
purpose advising the Department of Education on the design of systems for collecting and 
reporting information on vocational education. 

To that end, the study aimed (1) to identify and rank needs for national data on 
vocational education, (2) to examine current data collection activities and identify gaps in 
information on vocational education, (3) to examine conceptual and methodological 
issues complicating data collection, and (4) to assess the data collection and reporting 
capacities of local and state providers of vocational education. To meet these objectives, 
the study conducted three major activities. First, study staff held a series of national 
meetings with a Professional Working Group (PWG) and other interested parties to 
discuss data issues, needs, and priorities. Second, the study team assembled information 
on current data collection efforts relevant to vocational education. As a part of this 
activity, study staff reviewed in detail the vocational education data elements that are 
currently used by the Department of Education and other federal agencies in their 
national statistical surveys. This review led to a comprehensive map of existing national 
data on vocational education. Third, study staff conducted a series of brief case studies in 
each of six states. The study team visited local and state personnel in each of these states 
to assess local and state data collection capacity as well as the extent of uniformity and 
comparability within and among states in data collection and reporting. 

This report sets forth the findings and recommendations of the study. This 
introductory chapter reviews the policy and program management questions that data 
must address, the different functions that data serves, the history of past efforts to collect 
information on vocational education, and the status of current data-collection strategies. 
"Describing Context and Trends" examines the kinds of data required to provide general 
contextual information about vocational education, as well as information about 



important trends. "Describing Program Practices" discusses data requirements for 
describing program practices, including evaluating specific federal policy initiatives. 
"Monitoring Program Compliance" reviews the data required for monitoring compliance 
with federal regulations. "Monitoring Program Performance" looks at data requirements 
for monitoring program performance at the local and state levels and their relationship to 
federal data needs. The concluding chapter summarizes the study's findings and 
recommendations. Appendices include the data map, describe the results of the case 
studies, and list participants in the PWG and other national meetings. 



Primary Questions 

Typically, major policy and program management questions about vocational 
education seek information on seven different topics: (1) organization and governance, 
(2) student participation, (3) program offerings, (4) accomplishments, (5) personnel, (6) 
facilities and equipment, and (7) costs. To better understand the kind of data needed to 
address these questions, this introductory chapter begins by briefly examining some of 
the most frequently voiced concerns with respect to each of these topics. 

Organization and Governance 

Delivering vocational education is primarily the responsibility of local and state 
governments. Federal funds for vocational education constitute between five and ten 
percent of the total expenditures for vocational education. A few states provide 
categorical funding for vocational education, but most support vocational education 
through general state aid to secondary and postsecondary programs. Not surprisingly, 
therefore, there is considerable variation in the ways in which vocational education is 
organized and governed throughout the nation. 

Vocational education is offered through both secondary and postsecondary 
institutions. Many states also offer courses in the middle school grades. Typically, these 
are courses in industrial arts (now called industrial technology or technology education in 
many places) and in home economics (also called consumer and homemaking education 
or life management). Such courses are also offered in most public high schools. At the 
secondary level, vocational education is primarily a public offering; few private schools 
offer vocational education, not even industrial arts or home economics. While the 
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arrangements differ somewhat from state to state, in all states, comprehensive high 
schools provide some vocational education programs. 

Many states have also established systems of area vocational schools. Area 
schools operate under a joint services agreement established between two or more 
comprehensive high schools (usually including two or more school districts) or under the 
aegis of a separate county school district. In at least two states, New York and Colorado, 
area schools are operated by Boards of Cooperative Education Services (BOCES) and 
include special education services and other types of activities provided jointly by 
participating districts. California calls its area schools Regional Occupational Centers 
and also operates shared-time Regional Occupational Programs at some comprehensive 
high schools. As typically organized, area schools enroll high school students in 
advanced vocational education programs for part of the day. These students take 
academic classes and other electives in their home high school, which is also the locus for 
extracurricular activities. 

Some school districts, mainly in large cities, also operate full-time vocational high 
schools. These schools offer the full spectrum of vocational and academic classes, often 
organized around particular clusters of occupations or a specific industry such as health, 
business, or aviation. Full-time vocational schools differ from comprehensive high 
schools in that all students are expected to participate fully in the vocational curriculum. 

At the postsecondary level, both private and public institutions offer vocational 
education. Public two- to three-year institutions (community colleges) serve over half of 
the students enrolled in postsecondary vocational education programs. Some four-year 
institutions offer vocational education, primarily through associate degree programs. A 
few states operate vocational/technical institutes. These are nondegree-granting 
institutions providing vocational education programs of up to two years in length. In the 
private sector, both nonprofit and for-profit institutions offer postsecondary programs. 
Private, for-profit institutions (commonly called proprietary schools) provide a range of 
offerings, from relatively short-term programs in truck driving or bartending to two-year 
associate degree programs in business or health. There are a number of private, 
nonprofit, less-than-four-year institutions offering postsecondary vocational education; 
private, nonprofit nursing schools are a typical example of this type of institution. Area 
schools that serve high school students also provide programs for adults, usually in the 
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evenings. Some area schools intentionally mix adults and high school students during 
their regular daytime programs, since adults can provide good role models for high 
school students and can facilitate teaching. 

In recent years, a number of states and local secondary and postsecondary school 
districts have been encouraging the development of Tech Prep or 2+2 programs. These 
programs span the last two years of high school and the first two years of postsecondary 
education. Some (sometimes called 2+2+2 programs) also lead to further postsecondary 
education at four-year colleges and universities. In some cases, Tech Prep programs are 
little more than simple articulation agreements between secondary and postsecondary 
districts. In others, they are sophisticated, jointly funded programs that allow high school 
students to receive both high school and college credit for classes they attend at 
community colleges. 

While the framework of the secondary and postsecondary delivery system is 
generally well-understood, there is little accurate information on the numbers of different 
types of institutions offering vocational education in each of the states and territories. In 
general, better data exists about public institutions than about private institutions. 
However, information about public institutions is often incomplete and out of date. For 
example, there is no good, current information on the number of area vocational schools 
operating throughout the country. The Common Core of Data (CCD) purports to collect 
this information, but the data on area schools is inaccurate in several states. 

The complexity of governance of secondary and postsecondary vocational 
education makes it difficult to obtain good information about institutions providing 
vocational education. Federal law requires the states to designate a single state agency as 
the responsible authority for vocational education. While all states do, the requirement 
masks a wide range of approaches among the states to governing the delivery of 
secondary and postsecondary vocational education. 

Most states have created different governing boards for overseeing secondary and 
postsecondary education and even different governing boards for different systems of 
postsecondary education (e.g., a separate board each for community colleges, four-year 
state colleges, and universities). A few states have a separate state board for vocational 
education that operates independently from the secondary and postsecondary boards. 
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Responsibility for area schools or vocational/technical institutes may lie with entities 
other than the state board of education or the postsecondary board of governors 
overseeing community colleges. 



For private institutions, of course, there is usually no umbrella state agency with 
oversight responsibilities. A few national associations exist to represent the public policy 
interests of different types of private educational institutions, but the institutions 
themselves operate with high degrees of autonomy. 

These various governance arrangements complicate collecting information about 
vocational education. There is no single, identical entity in all states with responsibility 
for vocational education. Consequently, it is not always apparent to whom requests for 
information should be directed. The problem is compounded by the lack of a current, 
complete map of the kinds of governance arrangements for vocational education among 
the states and territories. 

A first step in improving national data about vocational education, therefore, is to 
develop a better picture of the various systems for overseeing public and private 
vocational education and the structure of the delivery system in each state. How is 
vocational education governed, and how many of the different types of secondary and 
postsecondary institutions offer vocational programs? A better understanding of 
organization and governance would not only direct national data collection efforts to 
appropriate sources of information about secondary and postsecondary vocational 
education, it would also help federal administrators and policymakers communicate better 
with local and state vocational educators. These organizational complexities, however, 
are not limited to vocational education. Data and policy on all secondary and 
postsecondary education might be improved by closer attention to issues of general 
education governance and organization in the states and territories. 

Student Participation 

Who participates in vocational education? Policymakers at all levels frequently 
ask this question. They want to know patterns of participation by race/ethnicity, gender, 
and various types of special needs. Special needs populations almost always include 
students with disabilities, economic or academic disadvantages, or limited-English 
proficiency. Additionally, federal policymakers have been interested in improving access 
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to vocational education for single parents, displaced homemakers, criminal offenders, 
adults in need of retraining, and individuals who participate in programs designed to 
eliminate sex bias. 

The question u Who participates in vocational education?" is often confused with 
the question "Who is a vocational student?" The two questions are quite different, and 
the first is much easier to answer than the second. At both the secondary and 
postsecondary levels, there is usually a well-defined vocational education curriculum, and 
identifying participants in this curriculum is relatively straightforward. However, if mere 
participation is synonymous with being a vocational education student, then almost all 
high school students and a very large percentage of students in less-than-four-year 
postsecondary institutions are vocational students. Among 1987 high school seniors, 
98% had taken at least one or more courses in vocational education during their high 
school careers; 79% of 1980 high school seniors enrolled in public two-year 
postsecondary institutions had taken at least one course in the vocational curriculum 
(Hoachlander, Kaufman, & Levesque, 1992). 

Implicit in the question "Who is a vocational student?" is some notion of 
concentration or specialization in the vocational curriculum. There are, however, no 
standards, either nationally or in most states, for what constitutes sufficient concentration 
or specialization for a student to count as a vocational student. Moreover, even if such 
standards existed, they could only be applied retrospectively to data accumulated over 
several years. For example, how would one know whether a high school freshman 
enrolled in Agriculture I counted as a vocational student? The student may go on to 
concentrate in an agriculture program or may never take another vocational course. If 
concentration and specialization are the criteria for determining who is appropriately 
labeled a vocational student, such a determination can only be made after students have 
completed their secondary or postsecondary careers. 

Consequently, one must question the utility of the very notion of a vocational 
student. What purpose is served by seeking to label some students vocational? The 
extent of participation defines, at least in part, the scope of the vocational education 
enterprise. Where there are well-articulated standards for what constitutes program 
completion such as acquisition of the necessary occupational and academic skills needed 
to succeed in the labor market, counting the number of vocational completers has value. 
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It is also useful to examine how different levels of participation in the vocational 
education curriculum are related to the mastery of occupational and academic skills. All 
of these issues, however, can be addressed by monitoring program participation and do 
not require an arbitrary definition of "vocational student." 

In the absence of a clear rationale, therefore, it is probably wise to drop the notion 
of "vocational student" from the policy lexicon and concentrate instead on measuring 
program participation and the number of program completers. Participation, of course, 
needs to be monitored by race/ethnicity, gender, and a variety of special needs. 

Program Offerings 

Under the 1990 Perkins Act, the term "vocational education" means 

organized educational programs offering a sequence of courses which are 
directly related to the preparation of individuals in paid or unpaid 
employment in current or emerging occupations requiring other than a 
baccalaureate or advanced degree. Such programs shall include 
competency-based applied learning which contributes to an individual's 
academic knowledge, higher-order reasoning, and problem-solving skills, 
work attitudes, general employability skills, and the occupational-specific 
skills necessary for economic independence as a productive and 
contributing member of society. Such term also includes applied 
technology education. (Section 521) 

Vocational education programs, therefore, can include — and indeed federal policy now 
encourages them to include — academic as well as vocational courses. Moreover, federal 
policy intends that vocational education emphasize and contribute to the acquisition of 
academic knowledge and skills in addition to occupational competencies. This direction 
represents an important departure from past conceptions of vocational education, which 
stressed occupationally specific skills. 

At the secondary level, the vocational curriculum has traditionally been organized 
under nine different program areas: 

1. Consumer and homemaking education (sometimes called home economics and 
now increasingly referred to as life management) 

2. Industrial arts (increasingly called industrial technology or technology education) 

3. Agriculture 

4. Business 



5. Marketing and distribution 

6. Health 

7. Occupational home economics 

8. Trade and industry 

9. Technical education 

Of the nine programs, seven (excluding [1] consumer and homemaking education and [2] 
industrial arts) are often referred to as occupationally specific programs or programs 
providing "specific labor market preparation" (Choy & Horn, 1992; Gifford, 
Hoachlander, & Tuma, 1989). Postsecondary offerings are similar and also exclude 
consumer and homemaking education and industrial arts. 

Policymakers generally ask two kinds of questions about program offerings: (1) 
What programs are offered, and (2) How much vocational education do students take? 
Related questions concern the quality of these offerings, especially the extent to which 
they meet the needs of current and future labor markets and enhance American 
competitiveness and productivity. 

What Programs Are Offered? 

At the national level, the Classification of Instructional Programs (CIP) has been 
the primary system used by the Department of Education to describe vocational education 
offerings (Morgan, Hunt, & Carpenter, 1991). At its most general level, the CIP assigns 
two-digit codes to the nine major divisions of vocational education. Health professions 
and related sciences programs, for example, all have the two-digit code 51. In some 
cases, more than one two-digit code comprises a vocational program area. For example, 
trade and industry programs include codes 46, 47, 48, and 49, encompassing construction 
trades, mechanics and repairers, precision production trades, and transportation and 
materials moving workers programs, respectively. Within each of these major 
occupational areas, CIP uses an additional two digits to define more specific programs. 
In health, for example, the code 51.08 defines programs in the health and medical 
assistants area. An additional two digits further identifies programs within the four-digit 
program area. The code 51.0802, for example, stands for a program training students for 
the occupation of medical laboratory assistant. In summary, therefore, it is possible to 
describe program offerings at the two-, four-, and six-digit levels. 
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In all, there are seventeen two-digit codes describing the seven occupationally 
specific programs. Within these seventeen areas, there are approximately 120 different 
four-digit vocational education programs. At the six-digit level, there are over 550 
individual vocational education programs covering such diverse subjects as soil and water 
mechanical practices, business data entry equipment operation, fashion merchandising, 
respiratory therapy technology, custom tailoring and alteration, electromechanical 
technology, and cooling and refrigeration. 

How much programmatic detail is necessary in reporting data for public policy, 
especially at the national level? The answer depends, in large part, on whether one is 
interested in program enrollment or program completion. At both the secondary and 
postsecondary level, students enroll in courses, not in programs. While a particular 
course can usually be identified with one of the major two-digit program areas, quite 
often it will be part of two or more programs at the four- or six-digit level. A student 
enrolled in Accounting I, for example, could be pursuing any one of six cr seven four- 
digit business programs. It is often not possible, therefore, to report accurately 
enrollment below the two-digit program level. However, when a degree or certificate is 
awarded upon completion of a program, identifying the program at either the four- or six- 
digit level poses no particular problems. Because completion represents (or at least 
should represent) readiness to work in a related occupation, completion information at the 
four- or six-digit level is useful for assessing labor market supply. Consequently, if 
gathering programmatic detail is required by policy concerns, it should focus on program 
completion rather than program enrollment. 

How Much Vocational Education Do Students Take? 

While indicators of the amount of activity in vocational education, enrollment and 
completion data do not provide an accurate picture of the magnitude of the enterprise. 
Assessing the level of effort students expend in vocational education requires additional 
measures. At the secondary level, the Carnegie unit is the common measure of the 
amount of vocational education taken by students. A Carnegie unit is the equivalent of 
taking one 45- to 55-minute course five days a week for about 180 days a year (or the 
length of the academic year). At the postsecondary level, semester credits or quarter 
credits are the most frequently used measures. At both levels, measures of contact hours 
or full-time equivalents (FTE) sometimes replace Carnegie units or credits. In some 
instances, such as in many postsecondary proprietary schools, there is no common metric, 
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and it is possible only to measure the number of courses taken. Efforts to collect 
information about the amount of vocational education taken by students (e.g., through 
transcript studies, for example) must struggle with procedures for converting these 
different methods for measuring class time into a single, common measure. Doing so 
successfully, of course, depends first on knowing what unit is being used by the reporting 
institution, not always an easy requirement to satisfy for students whose educational 
careers span two or more institutions using different systems. 

At the secondary level, transcript studies now provide accurate information on the 
number of Carnegie units students accumulate in vocational education. Depending on the 
sample size of these studies, this information can be reported by a two-, four-, or six-digit 
program area. As a general rule, however, it is difficult to obtain from transcript studies 
information for more than about thirty to fifty individual vocational education programs. 
More detail would require very costly increases in sample sizes. 

Carnegie units and credits mainly measure seat time. They are not direct 
measures of learning. Hence, there is a growing interest in other ways of assessing what 
is accomplished in vocational education, our next subject. 

Accomplishments 

In trying to gauge the effectiveness of vocational education, policymakers 
traditionally have focused on labor market outcomes. Measures such as placement rates, 
time to employment, earnings, time employed, and employer satisfaction have been used 
to assess how well vocational education serves the employment needs of business and 
industry as well as the career aspirations of program participants. 

Recently, policymakers have expressed a growing interest in the learning 
outcomes of vocational education. How well does vocational education contribute to the 
mastery of academic skills and students' abilities to apply these skills in work settings? 
Do students acquire the appropriate occupational competencies for performing on the 
job? The 1990 Perkins Act encourages vocational educators to pay more attention to 
teaching "all aspects of the industry." This prescription seeks to expand the focus of 
vocational education beyond narrow, job-specific skills to more generic knowledge about 
an industry's history, financial underpinnings, labor composition, technology, and place 
in domestic and world markets. 



Assessing accomplishments by measuring either traditional labor market 
outcomes or less conventional learning outcomes, poses many challenges. Local and 
state follow-up of labor market outcomes and other types of post-program completion 
consequences (e.g., enlistment in the military or pursuit of further education or training) 
have been plagued by short follow-up timelines and low response rates. National 
longitudinal studies have usually overcome these shortcomings, but limited sample size 
has often severely constrained analyses of program effectiveness. To date, evaluating 
learning outcomes has been forced to rely mainly on standardized achievement tests that 
were not designed with vocational issues in mind and that do not lend themselves to 
assessing workplace applications of academic skills. Several promising efforts to design 
alternative forms of assessment such as performance assessment and portfolios are 
underway but still several years from acceptable validity and reliability and widespread 
application. 

The nature of testing also differs markedly between secondary and postsecondary 
institutions. Universal, uniform standardized tests are much more common at the 
secondary than at the postsecondary level. Similarly, statewide curriculum and 
curriculum standards are more prevalent among secondary than postsecondary systems. 
Consequently, uniform evaluation of learning outcomes is more problematic for 
postsecondary vocational education programs. 

Personnel 

Policymakers have also asked questions about the characteristics of faculty and 
administrators responsible for delivering vocational education programs. What is the 
distribution of vocational education personnel at the secondary and postsecondary levels 
by race/ethnicity, gender, and age? What qualifications do they possess, and how much 
experience in education have they developed? Do they have clear connections to the 
industries for which they prepare students, and do they have current knowledge of 
industry-specific technology and labor skill requirements? 

Closely related to these questions are concerns about the adequacy of teacher 
training institutions, the fit between supply and demand for vocational educators, and 
leadership development. What institutions train vocational faculty? What kinds of 
programs do they offer prospective teachers? Are these in keeping with present and 
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future expectations about the kinds of knowledge, skills, and abilities students will need 
to succeed in particular industries and occupations? 

Data on both secondary and post secondary vocational faculty is now available 
from periodic surveys conducted by NCES. Relatively few secondary or postsecondary 
faculty teach both vocational education and academic subjects, so it is easy to isolate 
vocational faculty and describe their characteristics. 

Facilities and Equipment 

Policymakers and program managers have also asked questions about the 
facilities and equipment used for vocational education. Are facilities and equipment 
adequate? Are they under- or over-utilized? Are they in good condition? Are they 
adequate for serving physically handicapped students? Does the equipment used reflect 
the state of the art in the industry? 

Little data on vocational facilities and equipment is readily available. The last 
comprehensive study of facilities was completed in 1978 and did not include a study of 
equipment (Woodruff, 1978). While providing some information, current statistical 
surveys do not include a systematic overview of facilities or inventory of equipment. 
Although local providers of vocational education keep records of equipment purchased 
with federal funds, this information is not routinely gathered and provides only a partial 
picture of equipment used for vocational education. 

Costs 

Funding for secondary and postsecondary vocational education is largely the 
responsibility of local and state governments, with federal dollars representing a 
relatively small fraction of total spending for vocational education. Precisely what 
fraction federal dollars constitute is difficult to determine. Most states and local 
accounting systems track expenditures by object — salaries, benefits, supplies, equipment, 
travel, and so on — not by program. Most secondary and postsecondary systems can no 
more tell what they spend for vocational education than they can for math, English, 
science, or social studies. 
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Nevertheless, using information on FTE faculty or student contact hours in 
vocational education, it is possible to estimate total expenditures for vocational education. 
Best estimates of the percentage of total spending for vocational education accounted for 
by federal dollars have been in the range of five to ten percent. In recent years, the 
percentage has almost certainly been declining as the amount of federal spending has 
remained about constant and state and local spending for education has increased. 

Tracing the distribution of federal funds for vocational education poses no 
particular problems. States routinely keep track of allocations of Perkins funds to eligible 
recipients, and the information is reported annually to the federal government. Similarly, 
local recipients keep good records on uses of federal funds. Although local recipients are 
not required to report data on the uses of funds to Washington, the information is readily 
available for periodic special studies conducted by OVAE or as part of the National 
Assessment of Vocational Education (NAVE). At the postsecondary level, probably the 
greatest federal support for vocational education comes not from the Perkins Act, but 
from the various federal student aid programs that make loans and grants, which include 
the costs of tuition. 

Obtaining precise estimates of local and state expenditures for vocational 
education is more problematic, although a growing number of local recipients are 
beginning to maintain program budgets and accounting systems. A few states provide 
categorical assistance for vocational education, but most provide state support for 
vocational education indirectly through general purpose state aid, which local districts 
and institutions are free to spend as they wish. Similarly, local support for vocational 
education usually comes from general purpose property tax revenues rather than from 
levies earmarked for vocational education. In the absence of program budgets, therefore, 
it is impossible to obtain precise estimates of local and state expenditures for vocational 
education in any kind of inexpensive, routine fashion. Special studies are required. 

In summary, the most frequently asked questions about vocational education can 
be organized into these six major topics: (1) organization and governance, (2) student 
participation, (3) program offerings, (4) accomplishments, (5) personnel, and (6) costs. 
Data for each of these areas will be shaped by the specific functions the information 
serves. Assessing national data needs for vocational education, therefore, depends on a 
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clear understanding of the various functions related to the policy and program 
management concerns that vocational education data is expected to address. 

Functions of National Data on Vocational Education 

As directed by the 1990 Perkins Act, a national vocational education data system 
should provide Congress with information relevant to policymaking and tribal, local, 
state, and federal agencies wiih information relevant to program management. In order to 
meet these needs, national data must address four subsidiary functions: (1) describing the 
general context and trends related to vocational education; (2) describing program 
practices, including evaluating specific federal policy initiatives; (3) monitoring 
compliance with federal legislation; and (4) monitoring program performance. These 
four functions are not mutually exclusive. Data that serves one function can be useful in 
another, and data collected for all four functions can be used to establish federal policy 
and to manage programs. Nevertheless, the four functions are sufficiently distinct, so one 
must guard against the temptation to design a single system that will simultaneously meet 
the requirements of all four. The distinct requirements of these functions argue for a 
multiform system of vocational education data collection rather than a single, overarching 
design that will address all concerns. 

To illustrate, Congress has an ongoing, long-term interest in monitoring 
participation in vocational education by different subgroups of secondary and 
postsecondary students. Race/ethnicity and gender, for example, are two student 
demographic variables that have been the focus of national policy for some time. Most 
ongoing efforts to collect data on participation in vocational education curricula, as well 
as in academic curricula, routinely include such demographic variables. Hence, with 
these data collections, it is possible to monitor over extended periods of time trends and 
changes in students' patterns of participation in vocational education. 

A dataset well-suited for addressing ongoing interests, however, often will not 
help to assess more specific concerns that may be novel or short-term in interest. For 
example, it is not likely that the National Education Longitudinal Study (NELS:88) which 
follows a cohort of eighth graders beginning in 1988 will be very useful for evaluating 
the effectiveness of Tech Prep programs. NELS and other similar datasets, of course, can 
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play an important role in special, short-term evaluations. They can, for example, provide 
good information on the population at large against which the results of specially targeted 
data collection can be evaluated. These ongoing national data sources, however, are not 
sufficient sources of information for addressing most objectives of specific, short-term 
evaluations of new policy initiatives. NELS:88 was designed, baseline questionnaires 
developed, and samples drawn well before Tech Prep became a focus of federal policy in 
1990. While NELS:88 will provide excellent data on overall participation in vocational 
education, it will not permit much analysis of participation in Tech Prep. The evaluation 
of Tech Prep programs will require a separate, perhaps one-time study, with a data 
collection strategy designed specifically for that purpose. 

Similarly, accounting for the distribution of federal funds for Tech Prep programs 
will require information on the universe of recipients of federal funds for Tech Prep. The 
data collection design for an evaluation of Tech Prep will fall far short of the coverage 
needed for accountability of funds for Tech Prep. A separate, albeit more limited, data 
gathering effort is necessary to satisfy these compliance concerns. 

Finally, data useful for monitoring the performance of Tech Prep programs will be 
somewhat different from that required for the other three functions. Assuming program 
improvement is ultimately a local responsibility, data useful for monitoring program 
performance may need to reflect local needs and circumstances. Thus, while uniformity 
and comparability across localities and states may be desirable for general national 
policymaking and more specific policy evaluation, data for local program improvement 
may be useful only to the extent that they are not uniform and comparable. Data for 
monitoring program performance, therefore, will often require yet another approach to 
system design and data collection. 

In short, meeting multiple policy and program management objectives usually 
requires multiple instruments. This rule applies as much to the design of data systems as 
it does to the development of particular policy and program strategies. Design of a 
national vocational education data system needs to keep these various functions in mind 
and tailor systems accordingly. The "Describing Context and Trends," "Describing 
Program Practices," "Monitoring Program Compliance," and "Monitoring Program 
Performance" sections offer some general guidelines for collecting data that serve each 
function as well as describe current data collection efforts and identify gaps in 
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information needed to address the seven primary policy and program management 

questions. 

The more varied and distinct the functions of national data become, the less likely 
a single data system will be able to serve these many objectives. Multiple systems will be 
required. Unfortunately, this requirement has not been well-understood in past efforts to 
collect national data on vocational education. As the following discussion elaborates, the 
history of gathering national data on vocational education is replete with miscues that 
have severely undermined the value of the information collected. 



History of Collecting National Vocational Education Data 1 

Since the passage of the Smith Hughes Act in 1917, the federal government has 
collected statistics in some form on vocational education. Until 1963, these amounted 
only to gross counts of students enroned in the major program areas supported by federal 
aid: agriculture, business, trade and industry, and so on. The Vocational Education Act 
of 1963 and the 1968 Amendments began requiring a series of annual reports that 
contained more detailed reporting. In addition to enrollment in major program areas, 
states were asked to report information on total vocational education enrollment by race. 
They were also asked for information on enrollment of disadvantaged and handicapped 
students; enrollments in secondary, postsecondary, and adult vocational education 
programs; and expenditures from federal allocations as well as local and state 
expenditures for vocational education. 

Responsibility for collecting these data lay with the Bureau of Occupational and 
Adult Education (BOAE) in the then U.S. Office of Education. Although many states 
used some of their federal vocational education research funds to develop new automated 
information systems, little uniformity existed across states. Problems with inaccurate, 
inconsistent data persisted throughout the 1960s, and Congress frequently complained 
about the quality of information on vocational education. 
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Project Baseline 

To help address this problem, Congress established Project Baseline in 1970, a 
joint effort of the National Advisory Council on Vocational Education and the U.S. 
Office of Education. In Project Baseline's own words, the project "was established to get 
the information everyone needs and no one seems to have" (Lee, 1972). Baseline 
attempted to work with each of the states to develop a more complete and more reliable 
national picture of secondary and postsecondary vocational education. 

Despite five years of effort, Project Baseline was unable to overcome most of the 
problems that had plagued the collection of vocational education data throughout the 
1960s. Enrollment data still fluctuated wildly from year to year. Follow-up information 
was either unavailable or based on such small response rates that the data was useless. 
For example, in 1972, twelve states reported secondary enrollment in vocational 
education that was more than twenty percent greater than enrollment in 1971. Thirteen 
states in 1973 and 1974, fourteen states in 1975, and seven states in 1976 reported 
secondary enrollment increases of more than twenty percent from the previous year. 
During the period 1971 to 1976, from twelve to twenty-four states regularly reported 
annual data on the number of program completers that represented increases of more than 
twenty percent over the previous year (Benson, Hoachlander, & Johnson, 1980). While 
general secondary enrollment was still growing modestly in the early 1970s, the growth 
was not large enough to make credible changes of more than twenty percent in vocational 
education enrollments. 

To its credit, Project Baseline did not mindlessly report these large fluctuations. 
Baseline sought explanations from the states; and in most instances, there were good 
reasons for the annual differences: new definitions, alterations in reporting systems, 
duplicative counting, late reporting, and missing data were but a few of the causes of 
inconsistent reporting over time. However, while Project Baseline could explain the 
problems, it could not correct them. The sorry state of vocational education data was left 
unchanged, and Project Baseline ceased collecting data after 1976. 

The Vocational Education Data System (VEDS) 

In 1976, Congress decided to move primary responsibility for vocational 
education data collection out of BOAE and lodge it with NCES. As NCES was the 
primary repository for educational data and had the expertise to oversee the design and 
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implementation of large scale data collection efforts, Congress hoped that NCES would 
produce more reliable information on vocational education. Thus, the 1976 Amendments 
to the Vocational Education Act directed NCES to design and operate a VEDS. Congress 
wanted VEDS to supply annual information on vocational education students, programs, 
program outcomes, staff, facilities, and expenditures. Congressman Carl Perkins (1981) 
summarized the general purpose of VEDS in his opening remarks on VEDS during 
hearings on December 10, 1981: "In mandating this system, Congress was responding to 
a lack of adequate data to judge program effectiveness and to make important decisions 
about future directions." 
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After almost two years in the design stages, VEDS began collecting data in 1978- 
1979. No one knows how much VEDS cost — some estimates were as high as $200 
million when the resources expended by local and state personnel were counted — but by 
1983, despite extraordinary efforts and expense, the realization was growing that the 
latest attempt to improve vocational education data had failed. In 1983, NCES performed 
a number of validity tests on the four years of accumulated data. These checks confirmed 
what many critics of VEDS had argued from the outset, that three major problems 
plagued the system: 

1. Lack of comparability among states. Data was not comparable from state to state 
and, therefore, yielded misleading national totals when aggregated. 

2. Year-to-year variability. The data exhibited excessive variation over time, which 
was difficult to explain. Consequently, the VEDS data could not be used to 
describe trends over time accurately. 

3. Within-state discrepancies. When VEDS data from some states were compared to 
state data from other sources, many large discrepancies were observed; these 
could not be adequately explained. 

Following these findings by NCES, the Office of Management and Budget 
(OMB) withdrew approval in December 1983 for collecting VEDS data for 19834984 
and 1984-1985, because "VEDS has substantial and continuing problems collecting data 
which are accurate and meaningful." In a memo, the OMB (1983) directed that the 
"collection should not be undertaken at this juncture and should remain suspended until 
the Department [of Education] has fully implemented the plan for improving VEDS." 

Improving VEDS, however, proved impossible. Although some parts of the 
system probably did produce reasonably accurate information, the widely circulated 
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horror stories (more Native American secondary students enrolled in vocational education 
in one state than the state's total population of Native Americans) subjected VEDS to 
such ridicule that there was little hope of salvaging any credibility for an improved 
system. In February 1984, the NCES Administrator, with the concurrence of OVAE 
(formerly BOAE), issued the following statement in a memo to the Secretary of 
Education: 

The current [VEDS] system has serious technical problems. NCES 
believes that the technical problems do not lend themselves to correction 
without a major system redesign. The data are unreliable and subject to 
serious misinterpretation. 

Consequently, VEDS was permanently terminated, and another major effort to produce 
accurate, reliable national data about vocational education had failed. 2 

Despite the termination of VEDS nationally, many states have continued to 
operate modified versions of VEDS for their own purposes. While unable to achieve the 
uniformity and comparability necessary in a national data system, VEDS did succeed in 
stimulating states to pay more attention to vocational education data and develop systems 
that better met local and state policy concerns. 

Data Collection Under the Carl D. Perkins Vocational Education Act of 1984 

In fall of 1984, Congress tried once again. The Carl D. Perkins Vocational 
Education Act of 1984 directed NCES to develop "a national vocational education data 
reporting and accounting system using uniform definitions. The system required by this 
section was to include the following information on vocational education: 

• Students (including information concerning race, sex, and handicapping 
condition) 

• Programs 

• Program completers and leavers 

• Placement and follow-up 
Staff 



2 For an excellent analysis of the problems inherent in the design and implementation of VEDS, see 
Barnes, 1984. 
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• Facilities 

• Expenditures in relation to the principal purposes of this Act (Section 421) 

This data collection mandate, however, differed from VEDS in one very important 
respect: NCES was to rely on sample surveys rather than a universal census. 
Furthermore, the information would be updated every other year rather than annually. 
There was one major exception to the use of sample surveys. Section 423 directed NCES 
to collect information on all secondary handicapped students enrolled in vocational 
education and to report this information by four-digit CIP code, instructional setting, and 
handicapping condition. 

The 1984 Perkins Act also continued the National Occupational Information 
Coordinating Committee (NOICC) and charged it with assisting states in developing and 
implementing state occupational information systems to meet the needs of both 
vocational education and employment training programs. The primary objective of these 
systems is gathering information on labor market supply and demand and making the 
information accessible to a variety of users. 

Efforts to comply with these directives on data collection proceeded much more 
cautiously than the earlier attempt with VEDS. Rather than develop an independent 
system for vocational education data collection, NCES relied on a strategy that 
emphasized using a variety of existing data collection efforts and, when necessary, 
modifying them to obtain better information on vocational education. Thus, requests for 
data on vocational education would be embedded in ongoing studies of the larger 
secondary and postsecondary education enterprises. These studies included the National 
Longitudinal Study of the Senior Class of 1972 (NLS-72), High School and Beyond 
(HS&B), and NELS:88. NLS-72 and HS&B figured prominently in the analyses 
undertaken by the first NAVE, the assessment required of the Department of Education 
by the 1984 Perkins Act (Section 403a). Additionally, NAVE, in cooperation with the 
Office of Special Education and Rehabilitation Services (OSERS) and NCES, led an 
effort to use the National Assessment of Educational Progress (NAEP) to collect recent 
secondary school transcripts to analyze participation patterns in secondary vocational 
education. 
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Special attention was paid to using this NAEP supplement to develop information 
on the coursetaking patterns of handicapped students. Although the 1984 Perkins Act 
directed NCES to collect information on all handicapped students, NCES maintained that 
this request was unworkable. Section 423 would simply have forced NCES to repeat the 
VEDS fiasco, albeit limited only to handicapped students. In contrast, the NAEP 
transcript supplement, while limited to a national sample of handicapped students, 
yielded for the first time a rich database on the participation patterns of handicapped 
students in all aspects of the secondary school curriculum, vocational as well as 
academic, by instructional setting and handicapping condition. 

Additional information on secondary vocational education has since become 
available from the Schools and Staffing Survey, which was conducted by NCES during 
the 1987-1988 school year. NELS:88, the most recent longitudinal study undertaken by 
NCES, is also providing a longitudinal portrait of participation in vocational education 
beginning with the eighth grade. 

At the postsecondary level, NCES has sought to revamp the Higher Education 
General Information System (HEGIS) to include the full array of institutions offering 
vocational education outside of high schools. This revised data collection, called the 
Integrated Postsecondary Education System (IPEDS), replaced HEGIS and has become a 
major source of data on postsecondary vocational education enrollment and completion 
as well as postsecondary staffing, finances, and institutional characteristics. In many 
respects, IPEDS retains many of the assumptions and approaches to data collection that 
proved ineffective in VEDS. While a thorough assessment of the quality of data on 
vocational education generated by IPEDS is beyond the scope of this study, there are 
indications that the IPEDS data on enrollment suffers from the same problems of 
consistency and comparability that plagued VEDS. These problems will need further 
investigation. 

Additionally, the postsecondary transcripts collected for NLS-72 and HS&B 
provide a wealth of data on postsecondary coursetaking patterns in vocational education. 
Finally, the National Postsecondary Student Aid Survey (NPSAS) made data on financial 
assistance available on postsecondary students participating in vocational education in the 
full array of postsecondary institutions, including proprietary schools. 
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NLS-72 and HS&B, as well as NLS Youth — the longitudinal study maintained by 
the U.S. Department of Labor — have also proven to be excellent sources of data for 
analyzing labor market outcomes associated with participation in vocational education. 
Not only do these studies overcome the problem of poor response rates, but they also 
permit tracking the labor market experiences of participants over much longer periods of 
time. 



Data Collection Required by the Cari D. Perkins Applied Technology Education Act 
of 1990 

As noted at the outset, the 1990 Perkins Act directs the Secretary of Education to 
establish a vocational education data system. It should be apparent, however, that a 
system of sorts, or at least major parts of a system, is already in place. Much of what 
Congress requested in the 1990 Perkins Act is available in more useful, accurate, and 
consistent forms than ever before. Moreover, the 1990 Perkins Act reestablishes the 
NAVE and requires a number of special studies by the General Accounting Office, 
Planning and Evaluation Services, and OVAE. 

In sum, the history of congressional mandates to collect vocational education data 
is a series of attempts that has assumed that uniformity can be obtained from an enterprise 
that is extraordinarily diverse. Moreover, legislation has not been adequately sensitive to 
how vocational education interacts with the rest of the education system and to the 
implications of these interactions for data collection. In responding to the mandate of the 
1990 Perkins Act, what is needed in the area of vocational education data is not a new 
independent, centralized vocational education data system. Much more desirable is a 
process for identifying major gaps in information and for deciding who is in the best 
position to fill them. Additionally, information on vocational education can be improved 
by concentrating on fine-tuning existing and planned data collection efforts to improve 
timing, eliminate inconsistencies, and to take advantage of low-cost opportunities to 
collect additional data. Finally, while data collection should remain decentralized, it 
would be desirable to centralize expertise in using these various datasets to analyze 
vocational education and provide quick, efficient responses to requests for information. 
Addressing such concerns is one of the primary aims of this study. 
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DESCRIBING CONTEXT AND TRENDS 

Purposes of the Data 

To assess the general evolution of vocational education nationally, policymakers 
and administrators need data that describes the big picture and trends and changes over 
time. Policymakers and administrators want to know basic information about the size of 
the vocational education enterprise: Is it growing or contracting, is growth greater at the 
secondary or postsecondary level, and are particular programs growing or contracting 
faster than others? Information about who participates in vocational education and to 
what degree is also important. Are the demographics of students changing with respect to 
age, race/ethnicity, gender, or special needs? Similar information about faculty teaching 
vocational education is also useful not only for monitoring the composition of secondary 
and postsecondary teachers but also for assessing potential shortages and surpluses of 
staff. Additionally, information on the outcomes of varying degrees of participation in 
vocational education is useful. What do students learn as a result of participating in 
vocational education, and how do they fare in the labor market over the long term? These 
are macro questions. Answers to them provide policymakers and administrators with 
information necessary for program planning and for setting priorities, targeting resources, 
and identifying areas needing new direction and leadership. 



Data Collection Methods 

Describing the general context for vocational education nationally and the 
relevant trends requires data that reflects a high degree of uniformity and comparability 
over the long term, as well as at any one point in time. The information, however, does 
not need to be collected very frequently because the variables usually do not change 
rapidly. Every four or five years is sufficient to detect trends and important changes. 

Contextual data on vocational education should not be collected in isolation from 
other types of experience. At times, it may be useful to compare various types of 
vocational education experiences, various levels of participation in vocational education, 
or participation in vocational education with nonvocational education. Additionally, data 
used to detect national trends should support both longitudinal and cross-sectional 
analysis. In some instances, it may be useful to follow the same students, faculty, 
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schools, or institutions over time; while in others, it may be sufficient to compare similar 
groups at two or more points in time. Longitudinal data is particularly useful for tracking 
the various educational and career paths and outcomes of students, and cross-sectional 
data helps describe the scope of the vocational enterprise at a particular point in time. 

Finally, sufficient data must be available to support relatively detailed analysis. If 
sampling methods are used, sample sizes need to be large enough to enable comparisons 
to be made among subgroups of the general population. However, not every study needs 
to address all questions. Therefore, the periodicity, context, type of trend analysis, and 
sample size of various data collection instruments may vary depending on the purpose of 
the study. 

Ongoing, national sample surveys are especially well-suited to providing 
information for longer-term concerns. Compared to universal censuses or elaborate 
experimental designs, such surveys are relatively low-cost, low-burden strategies for 
producing accurate national estimates of key variables. To ensure consistency over time, 
responsibility for administering these surveys has been lodged with particular federal 
agencies experienced in national statistics — the National Center for Education Statistics 
(NCES), the Bureau of Labor Statistics (BLS), and the Bureau of the Census (Census), 
for example. These agencies ensure that the integrity of the surveys is maintained and 
that institutional knowledge about the data and methods builds over time. Changes in 
these surveys can be made to accommodate new concerns. However, such changes must 
be made with care so as to maintain the historical value of the surveys and to ensure that 
the changes have long-term future utility. 

What makes these surveys so useful for describing the big picture renders them 
relatively ineffective for addressing shorter-run questions — for instance, about the 
effectiveness of particular government policies or initiatives. These surveys have long 
planning and implementation horizons that precede and cannot anticipate major shifts in 
national concerns about vocational education, nor are these surveys easily changed 
retroactively to reflect new initiatives. Understanding the consequences of particular 
policies and practices requires a very different approach (conducting special studies) that 
will be discussed in "Describing Program Practices/' 
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Existing Data Collection Activities 

NCES is the statistical agency with primary responsibility for collecting national 
data on education. Since 1984, NCES has relied on a strategy that gathers information on 
vocational education through a variety of existing survey instruments and in the context 
of general education. This integrated approach has had several advantages: (1) reducing 
the data burden on respondents by modifying existing data collection instead of creating 
new survey instruments; (2) increasing the reliability and comparability of the data 
collected by imposing uniform definitions and data collection procedures; and (3) 
increasing the power of the available data — for example, by facilitating comparisons 
between vocational and nonvocational education. 

The following list summarizes the current and planned NCES databases that 
contain information on vocational education. Appendix A contains data maps for both 
secondary and postsecondary education that describe many of these databases in finer 
detail, including the specific pieces of information that are available on vocational 
education. 

• Baccalaureate and Beyond (B&B) 

Beginning Postsecondary Students (BPS) (forthcoming) 
Common Core of Data (CCD) 

• Fast Response Survey System (FRSS) 

High School & Beyond (HS&B) Sophomore and Senior Cohorts 

High School Transcript Study (HSTS) (also referred to as the NAEP transcript 
study) 

• Integrated Postsecondary Education Data System (IPEDS) 
National Adult Literacy Survey (NALS) 

• National Assessment of Educational Progress (NAEP) 

National Education Longitudinal Study of 1988 (NELS:88 or NELS) 
National Household Education Survey (NHES) 
National Longitudinal Study of 1972 (NLS-72) 
National Postsecondary Student Aid Study (NPSAS) 
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National Survey of Postsecondary Faculty (NSOPF) 
Recent College Graduates Study (RCG) 
Schools and Staffing Survey (SASS) 



In addition to relying on in-house databases, NCES also conducts or plans to conduct 
studies of vocational education using databases supported by other federal offices and 
agencies: 

• Census of State and Federal Adult Correctional Facilities and Survey of Inmates 
of State Correctional Facilities, Bureau of Justice Statistics 

• Current Population Survey (CPS), Bureau of the Census 

• Education Profile Report and Post-Release Employment Project, Bureau of 
Prisons 

• National Longitudinal Survey of Youth (NLS-Youth), Department of Labor 

• National Longitudinal Transition Study (NLTS), Office of Special Education and 
Rehabilitative Services 

• Study of Conditions of Confinement in Juvenile Detention and Correctional 
Facilities, Office of Juvenile Justice and Delinquency Prevention 

• Survey of Income and Program Participation (SIPP), Bureau of the Census 

The primary databases containing information on secondary vocational education 
include NAEP, NELS:88, SASS, and NLTS. The primary sources of postsecondary 
vocational education information include BPS, IPEDS, NHES, NPSAS, NSOPF, CPS, 
and SIPP. Several databases contain information relevant to both secondary and 
postsecondary vocational education, including HS&B and NLS-72. The longitudinal 
surveys, NELS:88 and NLTS, will contain postsecondary information in the future but 
currently only cover the secondary education experiences of participants. 

These databases represent both longitudinal and cross-sectional data collection 
efforts. Cross-sectional surveys are conducted every two to four years at both the 
secondary and postsecondary levels: NAEP and NPSAS survey primarily students; 
SASS and NSOPF survey faculty; CCD and IPEDS collect data on the universe of 
secondary and postsecondary schools and institutions rather than rely on sampling 
techniques; and NHES and CPS collect information from the general U.S. population. 
Longitudinal surveys generally span both secondary and postsecondary education and 
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beyond and are launched approximately every eight years: NLS-72, HS&B, NELS:88, 
and NLTS follow students beginning in high school or earlier; BPS follows students who 
began their post secondary education in 1990; and B&B (replacing RCG) follows students 
completing their baccalaureate degrees in 1993, SIPP represents a frequent but short- 
term longitudinal study, selecting a new sample from the adult U.S. population every one 
or two years and following the employment and income experiences of that group for 
about two and a half years. 



Description of Available Information 

The following sections describe how the data that is available through the above 
databases address the key policy and program management questions identified in the 
introductory chapter, and they describe any major gaps in information. 

Organization and Governance 

CCD tallies the total number of public secondary schools in each state and 
provides information on the types of schools, including regular, special education, 
alternative education, and vocational education schools. By matching this information 
with data on educational agency type, the database attempts to sort out area vocational 
centers from full-time vocational high schools. However, because of variations in state 
reporting methods, CCD currently undercounts area vocational centers in some states. 
Furthermore, the database does not indicate to what extent regular, special education, and 
alternative education schools offer vocational education. At the postsecondary level, 
IPEDS surveys the universe of postsecondary institutions in the country, including public 
and private institutions, and identifies those institutions offering an occupational program 
of study as part of their curriculum. However, IPEDS currently undercounts private, for- 
profit (proprietary) schools. 

At the secondary level, the transcript studies are limited in their ability to provide 
information about student enrollment in area vocational centers. HS&B, NAEP, and 
NELS:88 do not include area vocational centers in their sample frames, although they ask 
whether vocational courses are taught off-campus. However, the accuracy of inferring 
area vocational center enrollments from information about the on- and off-campus 
location of courses has been questioned. Consequently, it is not possible to relate with 
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■ accuracy student participation, program offerings, or student outcomes to the various 
g types of vocational education delivery systems. Although SASS surveys area vocational 

■ centers, these schools are not oversampled and are too few in number to produce reliable 
comparisons among teachers employed in various school settings. 

Identifying various vocational education delivery systems is possible at the 
H postsecondary level. NSOPF contains data on faculty in all nonproprietary postsecondary 

institutions granting associate degrees or higher, including public and private four-year 

■ institutions; community colleges; and private, nonprofit, less-than-four-year colleges. 
• NPSAS contains information on students in all types of postsecondary institutions, 
tm including proprietary institutions and nondegree-granting vocational/technical institutes. 

■ Additionally, several longitudinal databases (HS&B, NLS-72, and BPS) contain or will 
contain transcript data from all types of postsecondary institutions offering vocational 

■ education, allowing comparisons across institutions at a fairly detailed level of analysis. 
However, as mentioned in the introduction, postsecondary institutions apply different 

■ methods for measuring class time, which presents a serious challenge to creating a 
common measure for comparison. Finally, NHES and CPS contain limited data on the 

■ participation of the general population in all types of postsecondary and adult vocational 

■ education. 

Student Participation 

m Section 421 of the 1990 Perkins Act requires that the vocational education data 

■ system that is the subject of this study contain data reflecting the extent of participation of 

— the following populations: 

™ • Women 

I • Native Americans 

• Individuals with handicaps 

m • Individuals of limited-English proficiency 

— • Economically disadvantaged students (including information on students in rural 
I and urban areas) 

• Adults in need of training and retraining 

■ • Single parents 

o 34 
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• Incarcerated youths or criminal offenders 

• Individuals in programs designed to eliminate gender bias and sex stereotyping 

• Minorities 

• Displaced homemakers 

Women, Native Americans, Individuals with Handicaps, and Minorities 

All the major secondary education databases containing high school transcript 
data (HS&B Sophomores, NAEP, and NELS:88) and even those without such transcript 
data (NLS-72 and HS&B Seniors) can identify women, Native Americans, handicapped 
students, and other minorities. The major postsecondary education databases (NLS-72, 
HS&B, IPEDS, CPS, and NPSAS) can also identify women, Native Americans, and other 
racial-ethnic groups, while several (NLS-72, HS&B, and NPSAS) include variables 
identifying handicapped students. NLTS will provide additional information on disabled 
students at both the secondary and postsecondary levels. 

Although these databases generally include Asians and Native Americans, the 
small sample sizes for these groups frequently render large apparent differences 
statistically insignificant. Furthermore, detailed analysis such as that by level of 
participation in vocational education, by institutional type, or by any other characteristic 
that requires dividing the sample of students into two or more groups almost always 
requires that researchers suppress statistics for these groups because the "cell size" (i.e., 
the number of students included in a specific category) does not meet minimum standards 
for confidentiality of the data. Similar problems occur when analyzing data for students 
by handicapping condition rather than overall handicap status and sometimes when 
analyzing data for Hispanic students. While sample size will inevitably become a 
problem as analysis is undertaken at finer and finer levels of detail, the small numbers of 
Asians and Native Americans, in particular, that are usually included in national studies 
makes even basic types of analysis difficult. 

Individuals of Limited-English Proficiency 

At the secondary level, only NELS:88 and NAEP 1990 identify limited-English 
proficient (LEP) students. The other secondary education datasets identify students 
whose home language is other than English but do not provide information about 
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proficiency. NAEP 1987 excluded severe LEP students from the main surveys, although 
it collected a small amount of data on such students, including achievement test scores, 
through a questionnaire completed by school officials. None of the postsecondary 
datasets currently identify LEP students. The 1993 NPSAS asks students to report the 
primary language that was spoken at home when they were children but does not provide 
information about English proficiency. 

Economically Disadvantaged Students 

At the secondary level, economically disadvantaged students are identified in 
several ways. Two of the datasets containing high school transcript data (HS&B and 
NELS:88) provide composite socioeconomic status (SES) variables created from parental 
background data such as mother's and father's occupations and education. NAEP 1987 
and 1990 include SES-type variables in the surveys but not in the transcript studies. 
NAEP's SES variables are constructed from information on mother's and father's 
education and a list of reading materials available in the home. All of the major datasets 
contain urban/rural information, although some of the data is problematic. 

At the postsecondary level, economically disadvantaged students can be identified 
using NLS-72, HS&B, and NPSAS. Although NLS-72 and HS&B provide composite 
SES variables created from parental background data, SES can be constructed in NPSAS 
from data on parents' educational levels, socioeconomic index scores of parents' 
occupations, and parents' income for dependent students. NLS-72 and HS&B describe 
the urbanicity of the student's high school. NPSAS provides information on the 
urbanicity of the postsecondary institutions but not of students' home communities. 

Although not mentioned specifically in Section 421 of the 1990 Perkins Act, 
academically disadvantaged students can be identified at the secondary level using 
NAEP, NLS-72, and HS&B. These databases contain information on high school grades 
and NLS-72 and HS&B contain assessment scores. The 1990 NAEP study will also be 
able to link student transcript information to test scores. At the postsecondary level, 
NPSAS 1987 provides CPAs for students taking credit-hour courses, and NPSAS 1990 
provides GPAs for all students. 

The methods used to identify economically and academically disadvantaged 
students in the above-mentioned national studies are not necessarily consistent with the 
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definitions included in the Perkins regulations. These regulations define an economically 
disadvantaged family or individual as eligible by the following criteria: 

Aid to Families with Dependent Children 

• Food Stamp Program 
Chapter I 

• Free or reduced-price federal lunch (however, the National School Lunch Act 
prohibits the identification of individual students) 

JTPA 

or by meeting any of the following criteria: 

• In receipt of a Pell Grant or assistance under a comparable state program 

• Determined to be low income according to the latest federal data 

• Identified as low income according to other indices of economic status 

Additionally, under the general definition of "disadvantaged" the regulations include 
migrants. 

Although the use of SES variables may be consistent with the item "other indices 
of economic status/* using additional measures of economic disadvantage could enrich 
existing analysis. For example, the longitudinal datasets that include adult cohorts (NLS- 
72, and HS&B Sophomore and Senior Cohorts) contain salary and public assistance 
history, and NPSAS provides information on state and federal financial aid and family 
income. However, collecting relevant information at the secondary education level is 
more problematic since student reporting of some of these variables may prove highly 
unreliable. Although an associated survey of school-level administrators could provide 
information on the program participation (Chapter I and JTPA) of individual students 
included in a study, such a survey could only indicate the overall proportion of students 
in the school or district receiving free or reduced-price federal lunches. Finally, none of 
the databases currently used for studies of vocational education identify students who are 
members of migrant families. 

The Perkins regulations define an academically disadvantaged individual as 
someone without learning disabilities who 
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• scores at or below the 25th percentile on a standardized achievement or aptitude 
test, 

• has a GPA below 2.0 on a 4.0 scale, and 

• fails to attain minimum academic competencies. 

Additionally, under the general definition of "disadvantaged/' the regulations include 

• LEP individuals and 

• dropouts or potential dropouts from secondary school. 

At the secondary education level, the several national databases containing 
assessment scores report these scores in terms of quartiles (i.e., four groups containing 
25% of tested students each), coinciding with the legislative definition. However, 
achievement test scores are generally not available at the postsecondary level. As 
previously stated, secondary and postsecondary transcript studies can generate GPAs. 
Currently, academic competencies are not identified separately from assessment scores 
and GPAs, and the legislation is unclear about how these competencies should be 
measured. However, possible methods include examining remedial coursetaking or 
determining whether students meet the minimum standards identified in the A Nation at 
Risk report (National Commission on Excellence in Education [NCEE], 1983). Although 
NELS:88 identifies LEP students, postsecondary databases do not. Finally, while the 
longitudinal databases and postsecondary-level studies can identify high school dropouts, 
it is unclear how potential dropouts should be identified. 

Adults in Need of Training and Retraining 

The identification of adults in need of training or retraining is problematic even in 
the longitudinal databases since the term "adults in need of training or retraining" has not 
been defined. Although many indicators are possible, the choice of any particular one 
would be subjective. Possible indicators might include periods of unemployment or of 
employment in low-paying occupations other than the occupation of the student's 
vocational training. However, if a student is working in his or her vocational area for low 
wages, does this indicate a need for retraining? Does every adult who has low wages or 
is unemployed need retraining? These questions need to be resolved before this targeted 
population can be identified. 
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Furthermore, NLS-72 is the only longitudinal study with a cohort that progressed 
far enough into adulthood (fourteen years out of high school at the time of the last follow- 
up in 1986) to indicate whether they might need training or retraining. When the data for 
the HS&B Sophomore Cohort 1992 follow-up (at the point ten years after high school) is 
analyzed, their retraining needs may begin to be apparent. However, since graduates in 
their 20s often try out different occupations and may work in low-level jobs temporarily 
regardless of their education, determining retraining needs may still be premature. 

Finally, one limitation of longitudinal studies is that they describe only the 
experiences of the cohorts included in them. Consequently, a cross-sectional, 
retrospective survey collecting data on the educational, vocational, and employment 
history of respondents would be a better source of information on the current number of 
adults in the population needing training or retraining. Such a survey could target either 
adults in vocational education or those in the general population. While existing cross- 
sectional surveys (NHES, CPS, and SIPP) estimate the number of adults participating in 
vocational education (and NHES collects data about their current educational 
experiences), they do not collect enough other educational or employment information to 
judge whether these adults in fact "need" training or retraining. 

Single Parents 

Single parents can be identified in every longitudinal dataset based on a cohort old 
enough to have children and report marital status, which includes every dataset except 
NELS:88. However, starting in 1990, even NELS:88 reports whether students have 
children. Additionally, two cross-sectional databases providing information on 
postsecondary vocational education (NPSAS and CPS) identify this special population. 

Incarcerated Youths or Criminal Offenders 

Several agencies gather information on incarcerated youths and adults. NALS 
samples inmates in state and federal prisons; the Bureau of Justice Statistics surveys state 
and federal adult correctional facilities and inmates in state correctional facilities; the 
Bureau of Prisons collects data on federal prisons and their former inmates; and the 
Office of Juvenile Justice and Delinquency Prevention collects data on juvenile detention 
and correctional facilities. Generally, the information on vocational education that is 
available from these sources is limited to whether incarcerated individuals participated in 
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any vocational training while in prison, although it may also include the duration of 
training. However, the Office of Juvenile Justice and Delinquency Prevention asks about 
participation in eleven vocational program areas, and the Bureau of Prisons tracks the 
recidivism and employment experiences of former inmates who completed vocational 
training during their prison stays. The surveys of adult and juvenile correctional 
education agencies and jail facilities, described in "Describing Program Practices" as part 
of the National Assessment of Vocational Education (NAVE) activities, will provide 
additional information on vocational education offered in these settings. 



Individuals in Programs Designed To Eliminate Gender Bias and Sex Stereotyping 

None of the datasets identify individuals participating in programs to eliminate 
gender bias and sex stereotyping in vocational education. At the secondary level, gender 
equity programs are not included in any dataset as one of the special vocational programs 
offered in the schools. Even if the programs v/ere included, they cannot currently be 
linked to data on individual students. The only existing means of measuring gender 
equity or sex stereotyping at the secondary education level is through transcript data by 
calculating the percentage of female and male students enrolled in each type of vocational 
program or course. While this measures the need for gender equity in each occupational 
program area, it does not indicate whether there is a special program designed to address 
the issue or whether any students participate in such a program. 

At the postsecondary level, IPEDS can be used to determine the percentage of 
female and male students earning degrees in each vocational program area every year. 
NPSAS can be used to calculate the percentage of female and male students who majored 
in each vocational program area during the survey years. NLS-72 and HS&B transcripts 
can be used to measure the percentage of female and male students taking each type of 
vocational course as well as the number of credits they earned in a vocational program 
area. 
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Displaced Homemakers 

The term "displaced homemaker" cannot be applied to secondary students until 
many years after high school because the classification is based on life experiences. The 
final regulations associated with the 1990 Perkins Act defined a displaced homemaker as 
an individual who (1) is an adult; (2) has worked as an adult primarily without pay to care 
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for the home and family and for that reason has diminished marketable skills; and (3)(i) 
has been dependent on public assistance or on income of a relative but is no longer 
supported by that income, (ii) is a parent whose youngest dependent child will become 
ineligible to receive Aid to Families with Dependent Children within two years of the 
parent's application for assistance under the Perkins Act, (iii) is unemployed or 
underemployed, or (iv) is described by (1) and (2) and is a criminal offender. 

The above definition allows researchers some flexibility in identifying this 
population. While, to be useful, databases must provide information on age and 
employment history, they need only provide additional information on either public 
assistance history or current employment status. Surveys of adult criminal offenders need 
to provide information on employment history. While comprehensive information on 
displaced homemakers requires all of these types of data, the information can be pieced 
together from a number of different sources. 

The primary challenge for providing information on displaced homemakers is 
defining what it means to have diminished marketable skills or to be underemployed. Do 
all adults who have been out of the labor market for a number of years possess 
diminished marketable skills? How should these skills be measured? Identifying 
underemployed adults presents the same definitional problem as identifying adults in 
need of training — if a student is working in his or her vocational area for low wages, does 
this indicate underemployment, or is every adult who has low wages underemployed? 
Careful attention needs to be paid to develop appropriate definitions of these concepts. 

The longitudinal datasets including adult cohorts (NLS-72 and HS&B Sophomore 
and Senior Cohorts) contain employment history and public assistance history, which can 
be used to identify adults who have worked in the home without pay, those who are 
unemployed, and those who have been dependent on public assistance. However, these 
cohorts are still too young to have been at home long enough to possess diminished 
market skills and are barely old enough to have raised children. For the most part, 
displaced homemakers in the generation that originally defined the term — women in their 
late 30s, 40s, 50s, and 60s who stayed out of the labor market to care for children and 
were supported by either a husband or public assistance — are not in these longitudinal 
datasets. 
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At least two cross-sectional surveys (NPSAS and CPS) provide partial 
information on displaced homemakers by identifying women who have been divorced or 
widowed and those with and without children and by providing information on their 
current employment status. However, better information on participants' educational, 
employment, and public assistance history is necessary to identify this population. SEPP 
provides information on current employment status, including reasons why respondents 
are unemployed (e.g., they are taking care of home or family and are on current sources 
of income, including relatives, friends, or public assistance). With respect to 
underemployment, SIPP asks respondents who are working part-time whether they are 
doing so because they could not find a full-time job. Finally, SIPP includes several 
questions on work, education and training, public assistance, fertility, and marital history, 
providing a potentially rich source of information for identifying displaced homemakers. 
However, the amount of information available on current participation in vocational 
education is limited. 



Program Offerings 

Secondary vocational education program participation is well-documented from 
high school transcript data for four recent cohorts, including 1982 high school seniors 
(the Sophomore Cohort) in the longitudinal HS&B dates, 1987 and 1990 seniors in the 
cross-sectional NAEP transcript studies, and 1992 seniors in the longitudinal NELS:88 
dataset. Program participation in these datasets is measured by the courses students took 
and the credits they earned in those courses. Participation in detailed vocational program 
areas can be monitored by classifying the courses at the six-digit CIP code level. In 
addition, the current National Longitudinal Transition Study (NLTS) on special education 
students is also collecting high school course records. The participation of later 
secondary school cohorts will be measured in future NAEP transcript studies (conducted 
approximately every three to four years) and in the next longitudinal study, 
approximately eight years after NELS:88. 

Current enrollments in postsecondary vocational education are documented in 
IPEDS and in CPS. IPEDS reports total enrollments by institutional type as well as by 
occupationally specific program below the bachelor's level. CPS reports the number of 
adults taking vocational courses by type of provider but does not report enrollments by 
vocational program or major. Two longitudinal datasets containing postsecondary 
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transcript data (NLS-72 and HS&B) can provide data on enrollment patterns in detailed 
vocational programs. However, this information covers only the included cohorts. 

NPSAS provides a periodic, cross-sectional survey of postsecondary students. 
Although it does not collect transcript data, NPSAS offers information on current 
enrollments in all types of postsecondary institutions and provides information on 
students' degree goals and majors at the six-digit CIP code level. However, it is unclear 
whether postsecondary institutions included in the survey define "enrollment" 
consistently and whether all students attending postsecondary institutions are represented, 
including students taking for-credit and not-for-credit courses and those with shorter- and 
longer-term goals (i.e., course completion versus certificate or degree completion). 
Furthermore, actual coursetaking patterns and students' ultimate degrees and majors upon 
graduation are not obtainable, except for that portion of the NPSAS sample who are 
included in the longitudinal BPS study. (Another subset of the NPSAS student sample 
will be included in the new longitudinal dataset, B&B; however, this dataset is not 
applicable to vocational education, other than vocational teachers, because it focuses on 
baccalaureate graduates only.) 

IPEDS provides data on postsecondary vocational program completion by 
detailing the number of degrees and certificates awarded annually by postsecondary 
institutions. The database can be used to identify the number of postsecondary awards in 
vocational/technical areas at the two-, four-, and six-digit CIP code levels. However, 
gender and race/ethnicity are the only student characteristics reported. 

Determining vocational program completion is much more problematic at the 
secondary education level. Schools do not usually award certificates or diplomas for 
completing a vocational program or indicate vocational program completion on student 
transcripts. Consequently, program completion must be inferred from coursetaking 
patterns as they are exhibited on transcripts. Considerable conceptual work needs to be 
done on what sequences or clusters of vocational and academic courses constitute 
programs. Furthermore, since postsecondary students participate in vocational education 
with widely varying goals, the award of a certificate or degree may not always be the 
most appropriate measure of completion for these students. Identifying additional 
measures of completion based on stated goals or on student or employer satisfaction with 
training may be worthwhile at the postsecondary level. 
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The sample size of the databases frequently limits the degree of programmatic 
detail that can be achieved in analyzing participation patterns. Transcript data usually 
produce reliable information on participation at the two-digit CIP code level, including 
about eleven vocational/technical programs. Although participation in as many as fifty 
programs can be examined, this level of detail requires suppressing a number of statistics 
because of low cell size, rendering comparisons among demographic subgroups 
incomplete. In contrast, IPEDS reports the number of instructional programs offered by 
an institution and the number of degrees and certificates awarded at the six-digit CEP code 
level, including several hundred programs. 

In addition to standard occupational programs, vocational education also offers a 
number of related programs and services. Although specific activities change over time, 
policymakers and administrators have an ongoing interest in understanding the range and 
prevalence of different types of programs and services offered. Categories of ongoing 
interest include relationships between secondary and postsecondary education and 
institutions; relationships between school, business, and industry; services provided to 
special populations; and related extracurricular activities. 



In recent years, school districts and postsecondary institutions have begun 
developing coordinated occupational programs spanning the last two years of high school 
and the first two years of higher education, referred to as Tech Prep programs. While an 
evaluation of Tech Prep will have to be undertaken through a special study of the sort 
described in "Describing Program Practices," it is possible to gather information on the 
prevalence of participation in the program through ongoing national data collection 
efforts. Data on the prevalence of Tech Prep may best be collected through periodic 
cross-sectional surveys at the secondary (NAEP) and postsecondary (NPSAS) levels. 
Furthermore, data can be collected at both the school and student levels: Is the school 
district or postsecondary institution a participant in a formal Tech Prep agreement? In 
what vocational program areas? Has the student included in the study formally enrolled 
in a Tech Prep program? What constitutes formal enrollment? Generally, these questions 
require surveying a school-level administrator familiar with the program, rather than 
relying on student-reported information. As part of the 1993-1994 SASS, NCES intends 
to ask secondary schools whether they have developed Tech Prep programs. 



er|c 39 4 



4 



Transcripts may be used to examine the coursetaking patterns of students enrolled 
in Tech Prep programs. However, not all longitudinal studies collect transcripts at both 
the secondary and postsecondary education levels, making it difficult to compare 
coursetaking patterns at the two levels. In any case, the student cohort included in the 
most recent longitudinal study (NELS:88) will have exited high school before most Tech 
Prep programs have been implemented. 

The 1990 Perkins Act also affirms an emphasis on serving members of special 
populations. An adjunct survey targeted at vocational education coordinators could 
attempt to describe the range and prevalence of services and activities that are provided to 
these populations, including those services and activities aimed at ensuring access to and 
success in quality vocational programs. Furthermore, services to disabled students could 
be examined by type of handicapping condition in order to assess at what level of severity 
students are being served (e.g., multihandicapped and mentally retarded students are 
generally considered to have more severe handicapping conditions than learning disabled 
and orthopedically impaired students). However, in order to provide reliable estimates by 
handicapping condition, surveys would need to oversample handicapped students, which 
could prove to be expensive. Such a survey could be associated with a cross-sectional 
study like the one described above or could replicate the 1984 HS&B administrator and 
teaching survey, which asked questions related to vocational programs and students. 
Although the 1984 survey suffered from low response rates and problems with the 
definition of vocational education programs, it could provide a point of departure for 
developing a similar survey in the future. 

Administrator and faculty surveys could also investigate school-business 
relations, including the extent and form of business involvement in developing vocational 
curriculum, identifying and acquiring state-of-the-art equipment, and providing work 
experience opportunities. Additionally, included among vocationally related programs 
are vocational student organizations (VSOs), which include such groups as Future 
Farmers of America (FFA), Vocational Industrial Clubs of America (VICA), and the 
Technology Students Association (TSA). VSO activities attempt to develop work habits, 
teamwork skills, and self-confidence; provide leadership and competition experience; and 
are frequently integrated into the regular vocational curriculum. Collecting information 
on the number of students participating in VSOs nationwide does not require new data 
collection efforts since each national-level VSO already collects data annually on the 
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number of dues-paying members. Furthermore, VSOs can provide data on the sex of 
their members and some can provide students' race/ethnicity and education level (middle 
school, high school, or postsecondary). However, this data is not currently reported by 
NCES or any other federal agency. 

In order to investigate the relationship between VSO involvement and other 
student characteristics and outcomes, this national membership data needs to be 
supplemented with data that is collected in the context of other educational activities. 
NCES has for some time included a question about VSO participation on its longitudinal 
surveys. However, the surveys do not ask to which specific organizations a student 
belongs. In addition, the surveys do not distinguish between membership and less formal 
participation in VSO activities. By revising the existing VSO-related questions, the 
longitudinal surveys could increase the analytic power of the data collected. However, 
the number of students participating in individual VSOs may be too small to produce 
reliable estimates. 

Accomplishments 

The longitudinal database for HS&B Sophomores (who were high school seniors 
in 1982) can link high school transcript data to subsequent labor market information, 
allowing researchers to relate detailed secondary vocational program participation to later 
educational and employment outcomes. HS&B also provides achievement test scores, 
which can be combined with program participation information to predict outcomes. In 
addition, while the student-reported GPAs have not proved reliable, GPAs derived from 
the high school transcripts can be used to assess the relationship between educational 
achievement and employment outcomes. Although this cohort was only four years out of 
high school at the time of the last follow-up in 1986, the 1992 follow-up will provide 
more substantial labor market outcome data. 

In the future, NELS:88 will provide similar information for 1992 seniors. The 
NELS:88 dataset includes math, science, reading, and history achievement test scores 
from the eighth, tenth, and twelfth grades; and the high school transcripts will include 
GPAs. These measures of educational ability and achievement can be used to predict 
later education and employment outcomes. 
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Both NLS-72 and HS&B permit linking students' postsecondary school 
transcripts to later educational and employment outcomes. However, only the NLS-72 
cohort is currently old enough to have substantial labor market outcomes to evaluate, 
although the HS&B Sophomore Cohort 1992 follow-up examines labor market outcomes 
ten years after high school and may be able to provide some information. Since the 
student sample in NPSAS is still in school, educational and labor market outcomes are 
not yet available. In the future, the BPS sample of NPSAS students will provide 
educational and occupational outcome information for the cohort that started 
postsecondary education in 1990, although it will be many years before their labor market 
participation is established. In order to link current employment information with past 
vocational training for a cross-section of the U.S. population, additional information on 
education history would have to be collected from participants in NHES and CPS. 
However, SIPP provides retrospective information on postsecondary vocational training 
and federal employment training for a cross-section of the population and links this 
information to current employment and income experiences. 

Existing studies have tended to use measures of academic ability and achievement 
to explain participation in vocational education or subsequent success in the labor market 
or through further education. These studies generally have not examined test scores and 
GPAs as learning outcomes in themselves. However, NCES researchers will link 
transcript data with achievement test scores using the 1990 NAEP in an effort to 
determine academic outcomes and relate them to vocational coursetaking. This effort 
raises an important methodological issue: the difficulty in attributing performance on a 
standardized test to a single course, or even to a group of courses. By using gain scores, 
researchers can narrow the period during which change occurs and more effectively 
isolate the causes of that change. However, NAEP will use only a single test 
administration. At the least, careful work needs to be done to develop appropriate 
sequences or clusters of courses that can explain academic performance. 

While achievement tests are routinely administered at the secondary level, similar 
measures of academic performance are not readily available at the postsecondary level. 
Currently, none of the existing national data collection efforts link postsecondary 
coursetaking with academic test scores. 
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Although some measures of academic outcomes are available, measures of 
occupational competencies and work readiness skills are not. Furthermore, measures of 
academic competencies as used in a vocational or applied setting and measures of 
learning about "all aspects of the industry" are also not readily available. Given the lack 
of widely recognized national tests of these skills, it is unlikely that much information 
concerning these learning outcomes will be included soon in national surveys. More 
conceptual work on what should be measured and on developing more appropriate 
assessment instruments needs to happen first. 

Personnel 

The 1984 HS&B administrator and teacher survey contains excellent questions 
about vocational teacher demographics, instructional methods, and efforts to find jobs for 
students and contains information on some teaching fields within vocational education; 
but the sample of teachers is too small to produce reliable results. Furthermore, the 1984 
HS&B survey is an older, one-time data collection effort that suffered from low response 
rates and definitional problems. SASS provides rich information on the demographics, 
teaching experience, education, salary, benefits, and attitudes of secondary school 
teachers. However, the sample size is too small to permit analysis of vocational teachers 
below the two-digit CIP code level, and many types of analysis can only be applied to 
vocational teachers as a group. The classification of teaching assignment categories was 
greatly improved in the most recent SASS. However, additional improvements could be 
made, including separating out marketing and distribution from business education; 
subsuming accounting under business education; moving home economics (consumer and 
homemaking education) to under vocational education and creating a separate 
classification for occupational home economics; including the new term "technology 
education" alongside industrial arts; and defining the use of the term technical education 
to include computer, communications, engineering, and science technologies. 

There is almost no information on secondary vocational administrators. Although 
two recent datasets (NAEP and SASS) included administrator surveys, NAEP did not 
identify vocational administrators separately from other administrators; and SASS, while 
identifying vocational administrators, asked them school-related questions rather than 
questions about their background or responsibilities. The 1984 HS&B administrator and 
teaching survey sampled vocational educational coordinators, but focused primarily on 
program- and student-related questions rather than on the administrators themselves. 
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The only data available on postsecondary faculty is through NSOPF. This survey 
provides information on the teaching fields of faculty members detailed to the four-digit 
CIP code. It also provides data on teacher demographics (gender, race/ethnicity, and 
age), educational background, part- and full-time teaching status, tenure, rank, salary, job 
and teaching history, workload, benefits, and attitudes. Although a rich dataset, NSOPF 
collects information on too few faculty having vocational education responsibilities to 
allow detailed analysis by vocational field. Furthermore, NSOPF collects data only from 
nonproprietary postsecondary institutions granting associate degrees or higher. Providing 
that sufficient funds were available, NCES should consider expanding the universe of 
NSOPF to include faculty in proprietary and less-than-two-year schools. NSOPF also 
contains virtually no information on postsecondary vocational administrators. Although 
NSOPF surveys department chairpersons, it provides faculty information only in 
aggregated form for each department. 

Existing data collection efforts do not facilitate linking teacher experience and 
qualifications to student outcomes, analysis which requires collecting data on teachers 
and students from the same institutions. While the 1984 HS&B administrator and 
teaching survey contains some information about vocational faculty, teachers cannot be 
linked to individual students. Although NELS:88 will collect information from two 
teachers for each student included in a subsample of the study, vocational teachers will 
not be surveyed. Finally, no surveys have linked postsecondary vocational/technical 
faculty with their students, although BPS could possibly do so. 

Linking vocational teacher experience and qualifications to student outcomes 
presents several challenges. Since linking information on teachers and students is an 
expensive undertaking, these issues require careful consideration. Policymakers, 
researchers, and educators must decide what outcomes can be attributed to individual 
vocational teachers. While it is reasonable to hold a teacher accountable for the learning 
that takes place within that teacher's classroom, some student outcomes such as job 
placement or program completion may have more to do with a student's cumulative 
school or program experience than with a single class or teacher. Furthermore, the 
learning that is assessed should be relevant to the vocational classroom environment. The 
validity of currently available standardized tests of academic skills as indicators of 
vocational teacher and student performance has been questioned. 
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Appropriate assessments of vocational student learning must be available before 
information on vocational teachers can be linked to the achievement of their students. In 
order to link student achievement with teacher experience and qualifications, NELS:88 
collected data from teachers who taught the subjects assessed through the study. For 
example, math teachers were surveyed because math was one of the subjects tested 
through a standardized assessment. Student achievement in math could thus be linked to 
information about math teachers. However, linking the vocational achievement of 
students to information about vocational teachers is constrained by the availability of 
appropriate assessments of students' occupational or applied academic skills. 
Furthermore, even if they were available, occupational assessments that are tailored to a 
large number of program areas may be far too costly to administer. However, if 
assessments of applied academic skills become available in the future, these may be 
suitable for both vocational and academic classrooms. 

A survey of faculty at either the secondary or postsecondary levels could include 
questions about vocational program involvement other than in the occupational teaching 
field. For example, faculty could be asked about their involvement in and responsibilities 
for Tech Prep and VSOs, although the number of faculty participating in these programs 
may be too small to produce reliable estimates. Surveys could ask about instructional 
methods, including different strategies for integrating vocational and academic education 
and teaching all aspects of the industry. More information on faculty preparation could 
also be gathered, including participation in staff development workshops on various 
topics emphasized in the Perkins legislation or time spent working in industry or in 
contact with industry. 

Facilities and Equipment 

There is no systematic overview of facilities in current NCES-type databases. 
Most surveys that collect secondary school-level data ask about services provided to 
students rather than about facilities. However, the HS&B 1984 survey of vocational 
coordinators does ask whether vocational training takes place at the school or elsewhere 
for seven programs areas, although as mentioned previously, the survey suffers from 
technical problems. At the postsecondary level, IPEDS asks only about library holdings, 
library costs, and physical plant costs. 
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There is also no systematic inventory of equipment of any type, let alone 
vocational education equipment. NAEP asks only about the number and use of 
computers in high schools. The HS&B survey of vocational education coordinators asks 
specifically about the presence of electronic and computerized equipment — electronic 
auto diagnostic equipment, micro- and mainframe computers, computer-aided design 
systems (CADs), and other computer-controlled machines — but does not ask about the 
quantity of these or about any other type of vocational training equipment. 

Costs 

CCD collects fiscal information from state education agencies, and IPEDS 
collects financial information from each institution. However, both surveys request 
information on expenditures by functional category (e.g., total salaries, benefits, and 
utilities), rather than by program. Consequently, expenditures for vocational education 
are not readily available. 

Summary of Data Availability 

Current data collection efforts on the part of NCES, the Census, and other federal 
agencies provide complementary and overlapping information on vocational education. 
However, while offering a rich and varied view, existing data is not able to answer all 
questions about the context and trends relevant to vocational education. NCES and other 
agencies have endeavored to improve the available information on vocational education 
and have done so in a number of ways. However, several broad problems remain: (1) a 
few gaps in information persist; (2) sample size sometimes hinders basic analysis; (3) 
coverage of vocational education delivery systems is incomplete; (4) certain special 
populations identified in the 1990 Perkins Act have not been defined adequately; (5) 
instruments measuring applied occupational and academic competencies and appropriate 
sequences of occupational and academic courses constituting programs have not been 
developed; (6) information on students, faculty, and institutions cannot always be linked; 
and (7) the timing of data collection does not always coincide with the cycle of 
reauthorization of federal funding for vocational education. 

These problems are not the sole responsibility of the statistical agencies. Some 
gaps are best filled by other types of data collection, described later in this report* In 
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some cases, improved information requires better coordination among all producers and 
users of vocational education data. 



Filling Gaps in Information 

Ongoing national data collection of the sort conducted by NCES does not 
currently provide systematic or comprehensive information on vocational administrators. 
Although several databases identify vocational administrators, they tend to ask school- or 
program-related questions rather than questions about the background and responsibilities 
of the administrators themselves. Additionally, existing survey instruments do not 
provide information on vocational teacher training practices. Although staffing surveys 
ask about the qualifications and experience of faculty, none of the surveys canvass 
teacher-training institutions to determine what instructional methods are currently being 
taught. 

NCES databases also do not include much information on the costs of vocational 
education, on facilities and equipment, or on governance structures and the organization 
of vocational education in each state. However, these types of information are more 
appropriately collected through other types of data collection, discussed later in this 
report. 



Sample Size 

Small sample size restricts analysis of vocational education in several ways. The 
small number of Asian and Native American students included in national surveys render 
large apparent differences statistically insignificant and hinder analysis by level of 
participation in vocational education and by institutional type. The overall sample size of 
the student databases also limits the amount of programmatic detail that can be examined. 
The small number of vocational faculty included in staffing surveys limits analysis to 
broad vocational teaching assignment categories and, in many cases, to vocational faculty 
as a group. While small sample size also generally prevents subnational comparisons 
(i.e., by state), this type of analysis is less appropriate for data describing general context 
and trends. The availability of state-level data are described in "Monitoring Program 
Compliance" and "Monitoring Program Performance." 
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Coverage 

Although existing national data provides a rich source of information on the range 
of vocational education arrangements and activities, several gaps persist. Current 
databases undercount the number of area vocational centers and postsecondary 
proprietary schools; do not always include an*a vocational centers, or sufficient numbers 
of them, in their samples; and do not include information on faculty in postsecondary 
proprietary schools and vocational/technical institutes. Although surveys collect data on 
students in all types of postsecondary institutions, it is unclear whether students taking 
noncredit courses and those with short-term coursetaking goals are always included. 
Furthermore, little information is known about the various reasons adults enroll in 
postsecondary vocational courses and whether those adults achieve their personal goals. 

Special Populations 

Before existing databases can be used to provide information on adults in need of 
training and on displaced homemakers, educators and labor market experts need to define 
more precisely these special population groups. Specifically, concerned parties must 
address what it means to be underemployed and to have diminished market skills. 
Additionally, in order for national databases to produce reliable information on students 
with limited-English proficiency and those who are economically disadvantaged, 
researchers must find better ways to identify these students. Specifically, surveys need to 
provide information on language proficiency rather than dominance and on factors 
indicating economic disadvantage that do not rely on student self-reports, particularly at 
the secondary education level. 

Occupational and Academic Competencies and Vocational Programs 

It will be some time before national databases can provide information on the 
occupational and applied academic competencies of students participating in vocational 
education. While a number of efforts exist nationwide to develop performance-based 
assessments, these are not readily available. Vocational educators also need to clarify 
what is meant by experience in and understanding of all aspects of an industry. In order 
to determine the extent of participation in vocational education and to relate this 
participation to various student outcomes, considerable conceptual work needs to be done 
to develop sequences or clusters of courses that constitute vocational programs. 
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Student, Faculty, and Institutional Data Linkage 

The structure of existing national surveys does not facilitate linking student, 
faculty, and school or institutional information. In particular, it has not been possible to 
link faculty qualifications, experience-, and instructional methods to student outcomes or 
to link school- or institution-level information such as the level of economic disadvantage 
among the student population, local business involvement in vocational education, and 
the quality of facilities and equipment to student outcomes or to program offerings. 
Furthermore, administrators or faculty have not been consulted consistently about the 
participation of students in Tech Prep, VSOs, or Chapter I programs and about students' 
LEP or academic disadvantage status. Finally, while parents could provide information 
on economic disadvantage or migrant status, particularly for secondary level students, 
they have often not been surveyed. Although NELS:88 will collect information from 
teachers and parents for some of the secondary education students in the study, no similar 
capacity exists at the postsecondary level. 



The timing of existing surveys does not always produce relevant data coincident 
with federal reauthorization of funding for vocational education. For example, no recent 
postsecondary transcript study has been conducted, and new postsecondary transcript data 
will not become available until the end of the 1993-1994 academic year. In some cases, 
this timing problem may be unavoidable. Because data on vocational education is 
collected in the context of other educational activities, the national surveys inform policy 
in several education-related areas and are subject to different reauthorization cycles. 

In summary, ongoing national data collection efforts can be improved in several 
areas to provide more complete information on the context of and trends in vocational 
education. However, this data is not sufficient to meet all policy and program 
management needs. The following chapter, "Describing Program Practices," examines 
data that describes program practices, including evaluating specific policy initiatives. 



Timing 
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DESCRIBING PROGRAM PRACTICES 

Purposes of the Data 

Ongoing, national surveys of the type discussed in "Describing Context and 
Trends" cannot answer many important questions about vocational program practices. 
Such surveys are limited in their ability to provide information on the organization and 
governance of vocational education in each state, on expenditures for vocational 
education, and on facilities and equipment. Accurate information on governance 
arrangements and organization is needed to direct requests for information to the 
appropriate sources and to facilitate communication between federal administrators or 
policymakers and local and state vocational educators. Such information also allows 
researchers to assess the strengths and weaknesses of the different arrangements for 
delivering vocational education. Information on local, state, and federal expenditures 
indicates the level of support offered to vocational education nationally — and offered to 
the activities, services, projects, and specific programs that comprise vocational 
education — in comparison with other educational activities. Information on the facilities 
and equipment used for vocational education provides an indication of student access to 
quality programs and of the relevance of training to industry practices. 

Surveys designed to provide consistent information on context and trends over 
time also cannot assess the impact of many major policy initiatives in vocational 
education. Most recently, the 1990 Perkins Act established five major objectives for 
federal vocational education policy: (1) targeting federal funds to recipients with high 
concentrations of economically disadvantaged students, (2) ensuring access to and 
success in quality vocational programs for members of special populations, (3) 
encouraging the integration of vocational and academic education curriculum, (4) 
stimulating the development of Tech Prep programs that articulate secondary and 
postsecondary offerings, and (5) promoting accountability through the development of 
performance measures and standards for vocational education. 

In assessing the impacts of these policy directions, two important sets of questions 
must be answered. First, what did local schools and institutions and states do in response 
to these initiatives? Were funds targeted? Were special populations served? Was 
curriculum integrated? Were Tech Prep programs developed? Were performance 
measures and standards implemented? Second, what impact did these policy responses 
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have on students participating in vocational education? As a result of these new policies, 
were students better prepared occupationally and academically to enter the labor market 
or pursue further education? Did they fare better in the labor market as a result? 

The first set of questions requires specific, immediate responses. Congress will 
surely want clear answers to questions of implementation as it considers reauthorization 
of Perkins legislation in 1994 and 1995. The second set of questions cannot be answered 
immediately. Sufficient time must pass before the effects of policy changes on student 
outcomes can be detected. It will probably be five years or more before Congress can 
expect information on how its most recent policy initiatives affect students. 



Data Collection Methods 

Gathering information on specific vocational education practices requires 
conducting special studies. Such studies typically are not the responsibility of the 
statistical agencies, but of agencies charged with evaluation, implementation, and 
research. Thus, the 1990 Perkins Act re-established the National Assessment of 
Vocational Education (NAVE), located in the Office of Educational Research and 
Improvement (OERI), and charged it with evaluating a wide variety of topics. The act 
required a variety of other evaluations of specific policies to be conducted by the General 
Accounting Office (GAO); Planning and Evaluation Services (PES), located in the Office 
of Policy and Planning (OPP); and the Office of Vocational and Adult Education 
(OVAE). These agencies are responsible for evaluating the implementation of Perkins 
legislation, and their findings will figure prominently in the next reauthorization. 

The 1990 Perkins Act also called for various research activities to be conducted 
through OERI and the National Center for Research in Vocational Education (NCRVE). 
While many of these activities such as developing new strategies that may influence 
future policy and practices are beyond the scope of this report, OERI and NCRVE also 
investigate program practices. 

Describing program practices requires unique, one-time (or infrequent) studies 
specially tailored to understanding specific practices. Unlike ongoing national data 
collection, which must maintain consistency and comparability over time and relies on a 
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limited number of narrowly defined data elements, special studies endeavor to describe 
practices thoroughly at a single point in time and to capture variations in approaches. In 
some cases, special studies must coincide with the implementation of particular practices. 
Special studies may rely on and combine different data collection strategies, including 
mail and phone surveys, case studies, and quasi-experimental designs. Such studies may 
use national statistical databases as a source against which to compare the results of 
specially targeted data collection. Special studies may survey the universe of program 
providers or a sample of those providers, depending on the purpose of the study. 

Since the organization and governance of vocational education within states 
change slowly, studies seeking to describe these arrangements need be conducted only 
infrequently, perhaps once every five or ten years. Studies investigating local and state 
funding practices and their relation to federal funding for vocational education, as well as 
facilities and equipment, should probably follow a similar time frame. 

Assessing the implementation of federal policy initiatives requires studies tailored 
to understand local and state responses to federal legislation. What specifically did 
localities and states do in response to the 1990 Perkins Act? Understanding the impact of 
policy on student outcomes will take longer. It is essential that policymakers understand 
that they cannot expect to see in the near future detectable changes in student outcomes 
resulting from the 1990 Perkins initiatives. At least one to two years are needed to 
implement the kinds of curriculum and organizational changes that Congress sought in 
demanding integration, Tech Prep, and performance measures and standards. Completion 
of a Tech Prep program will take a minimum of four years. Another one to two years 
following completion is needed to assess labor market outcomes. Allowing time for data 
analysis and reporting, one would not expect to see the results of, for example, a rigorous 
evaluation of Tech Prep until seven or eight years after the initial passage of the 1990 
Perkins Act. Although the national statistical surveys will be able to contribute to 
assessing these longer-term impacts, special studies and research will need to supplement 
them. 
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Existing Data Collection Activities 

The primary vehicle for collecting data on the impact of the 1990 Perkins Act on 
program practices is NAVE. Replacing an earlier study of vocational education 
authorized by the 1976 Vocational Education Act Amendments, NAVE was first 
established by the 1984 Perkins Act and was reauthorized in 1990. Currently, NAVE is 
required to study the distribution of federal education funds to the states as well as 
describe and evaluate the following ten features of vocational education: 

1. The effect on tribal and state administration of vocational education programs and 
on local vocational education practices. 

2. Expenditures at the local, tribal, state, and federal levels to address program 
improvement in vocational education, including the impact of federal allocation 
requirements (such as within-state allocation formulas) on the delivery of 
services. 

3. Preparation and qualifications of teachers of vocational and academic curricula in 
vocational education programs. 

4. Participation in vocational education programs — in particular, access of 
individuals who are members of special populations to high-quality vocational 
education programs and the manner in which this participation affects the delivery 
of services to such populations. 

5. Academic and employment outcomes, including analyses of (1) the effect of 
educational reform on vocational education, (2) the extent and success of 
integration of vocational and academic curricula, (3) the success of the school-to- 
work transition, and (4) the degree to which vocational training is relevant to 
subsequent employment. 

6. Employer involvement in and satisfaction with vocational education programs. 

7. The effect of performance standards and other measures of accountability on the 
delivery of vocational education services. 

8. The effect of federal requirements regarding criteria for services to special 
populations, participatory planning in the states, and articulation between 
secondary and postsecondary programs. 

9. Coordination of services. 

10. The degree to which minority students are involved in vocational student 
organizations. 

In order to fulfill its mandate, NAVE is employing a number of data collection 
strategies, including the following: 
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• State and local omnibus surveys 

• Community, tribal, and funding case studies 

• Perkins funding distribution analysis 

• Secondary and postsecondary program participation analysis 

• Surveys of adult and juvenile correctional education agencies and jail facilities 

• Employer surveys 

• Study linking unemployment insurance and student data 

The omnibus surveys were sent to administrators for vocational education at both 
the secondary and postsecondary levels in each state, and to administrators in a sample of 
secondary schools and districts and postsecondary institutions across the nation. 
Distributed in the spring of 1992, the surveys attempted to describe the current status of 
vocational education as well as any changes that occurred between the last year of the 
1984 Perkins Act and the first year of the new one. In order to provide more descriptive 
detail about the processes affecting vocational education, NAVE researchers also 
conducted twenty community case studies, eight funding case studies, and five tribal case 
studies. Additional analysis of how states distributed their Perkins funds under the new 
guidelines will be conducted using data submitted by the fifty states. 

Program participation is being analyzed using statistical databases from the 
National Center for Education Statistics (NCES). Three new surveys of adult and 
juvenile correctional education agencies and jail facilities in the fifty states were 
developed by OVAE and distributed in the spring of 1993. Employment outcomes are 
being analyzed through surveys of a sample of employers nationwide and a study linking 
unemployment insurance and student data in selected states. 

In addition to NAVE, several other federal agencies have recently conducted or 
are in the process of conducting special studies of vocational program practices. The 
following list summarizes the most relevant studies: 

Office of Vocational and Adult Education ( OVAE) 
• Performance measures and standards study 
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Planning and Evaluation Services (PES) 

• Tech Prep evaluation 

National Center for Research in Vocational Education (NCRVE) 

• Study of education and training for work 

• Study of strategies linking planning and evaluation 

• Surveys of performance measures and standards implementation 

• Study of performance measures and standards effects 

Although requiring that specific topics be studied, the 1990 Perkins Act allowed 
the designated agencies to design their studies as they deemed appropriate. Most of the 
studies have not yet been completed. The OVAE study of performance measures and 
standards will involve a mail survey of secondary and postsecondary vocational 
education administrators in the fifty states; and site visits to nine states, including 
interviews with local and state vocational educators; and other activities. The PES 
evaluation of Tech Prep will involve surveys of state-level coordinators and local Tech 
Prep programs, plus an in-depth examination of selected local programs and a 
longitudinal survey of a sample of Tech Prep students. The NCRVE study of education 
and training for work, conducted during 1990, involved interviewing a number of state- 
level administrators in each of the fifty states. The two NCRVE surveys of performance 
measures and standards implementation gathered information from all the states in the 
fall of 1991 and then again in the fall of 1992 and involved intensive phone follow-up 
with secondary and postsecondary vocational education administrators in each state. 
Finally, the NCRVE study of performance measures and standards effects will focus on 
four states, including visits at both the local and state levels in each. 



Description of Available Information 

The following sections describe how the information that is available through the 
above data collection activities addresses the key policy and program management 
questions identified in the "Introduction," and they describe any limitations of the data. 
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Organization and Governance 

Until very recently, the only comprehensive study of the organization and 
governance of vocational education was a study sponsored by the old Office of Planning, 
Budgeting, and Evaluation (OPBE) and conducted during 1977 (Woodruff, 1978). While 
providing information on each of the states and territories, the OPBE study also 
developed schemes for classifying the different types of governance and organization 
elements. The study included information for each state on the type of state board for 
vocational education, the composition of governing boards, agency responsibilities and 
authority, interagency coordination, and the history of changes in state education agencies 
affecting vocational education. The study also described for each state the numbers and 
types of institutions offering vocational education at both the secondary and 
postsecondary levels and the types of local delivery systems, regional service 
arrangements, local governing authority, as well as the composition of local authority and 
the type of fiscal agent. 

In late 1992, NCRVE published a study conducted by RAND of education and 
training for work in the fifty states (McDonnell & Zellman, 1993). Unlike the earlier 
OPBE study, the NCRVE study did not attempt to create new classification schemes for 
state practices. Instead, the study described how each state governs and finances 
education and training programs, providing an overview of five state and federal 
education and training programs: secondary vocational education, postsecondary 
vocational education, Job Training Partnership Act (JTPA), welfare-to-work, and state- 
funded job training. Descriptions of secondary and postsecondary vocational education 
included the types and numbers of institutions delivering vocational education in each 
state and the ways that states govern vocational education. The sections on governance 
identified for each state and at each level of education the governing board for vocational 
education, the governing board's responsibilities, the state agency with administrative 
responsibility, the extent of state influence over local secondary institutions, and the 
extent of state involvement in postsecondary vocational education. The study also 
included a description of the elements of each state's program approval process. 

While providing new information on the governance of job training programs, the 
NCRVE study did not provide the degree of comprehensive information that the earlier 
OPBE study on the governance of vocational education. Specifically, the NCRVE study 
did not describe fully the relationship between the state board for vocational education 
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and the agencies responsible for administering vocational education at both the secondary 
and postsecondary levels or between the state board for vocational education and the 
boards governing the responsible agencies. Neither did the study describe fully the types 
of institutions over which each administrative agency has authority. Consequently, the 
NCRVE study provides only a partial picture of vocational education in some states. 

NCRVE also recently published a study of strategies linking planning and 
evaluation in vocational-technical education lhat identified the most common structures 
of state vocational education administration (Elson, Oliver, & Strickland, 1992). The 
study provided organizational charts describing the five dominant relationships among 
responsible boards and agencies. However, the report did not indicate which states 
possessed which administrative structures, nor did the organizational charts incorporate 
the various types of schools and institutions offering vocational programs. 

Together, the two NCRVE reports provide substantial information on the current 
governance and organization of vocational education in the fifty states. Relatively little 
additional work needs to be done to provide a comprehensive picture of each state's 
system that includes a description of the relationships among all the relevant boards, 
agencies, and institutional types. 



Student Participation 

A primary emphasis of NAVE is to assess the access of special populations to 
quality vocational education. Information on this topic is being gathered through several 
methods. At the state level, the omnibus surveys asked about the steps states have taken 
to provide equal access. At the local level, the surveys asked about the types of 
supplemental services provided to the various special populations, about special 
population involvement in developing the local vocational education plan, and about total 
school enrollment and enrollment in vocational education of the different populations. In 
addition, the surveys asked about changes occurring over time with regard to these 
different factors. While describing overall participation in vocational education, the 
omnibus surveys did not provide information on enrollment of special populations in 
specific occupational programs. 

The case studies conducted by NAVE during the winter of 1992-1993 allowed 
researchers to identify exemplary vocational programs at a secondary or postsecondary 
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site, interview faculty and students in those programs, and observe classes in progress. 
The specific occupational programs that schools and institutions considered to be 
exemplary varied from site to site. Although researchers could easily identify the male 
and female students in a classroom, identifying other special populations was not possible 
just through observation. Researchers had to rely on faculty, counselor, and administrator 
knowledge of the students enrolled in order to assess whether the various special 
populations were participating. In some cases, student record data was available to 
confirm the professionals' impressions while in others they were not. 

The case studies were also limited in their ability to verify that a designated 
exemplary program was in fact a high quality vocational program. Frequently, programs 
were deemed exemplary because they held a high status among local vocational 
programs. In some cases, these programs had acquired a significant amount of state-of- 
the-art equipment or other technology. In other cases, exemplary programs held a high 
status because of the type of student they attracted, generally a college-bound student. 
Usually, local schools and institutions did not base exemplary status on expected or 
actual long-term labor market outcomes nor on the amount or type of learning in a 
particular program. (As performance measures and standards systems are established at 
the local level, schools and institutions should be able to provide better information on 
the relative performance of their various programs.) Although limited in ability to 
determine the quality of vocational programs, the case studies described the processes by 
which vocational programs achieved high status and by which students, particularly 
special population students, were encouraged or discouraged to enroll in those high-status 
programs. 

The enrollment of special populations in specific occupational programs 
nationally is more reliably determined using statistical databases. The NAVE study will 
examine the participation of special populations at the secondary level, using the 1982 
High School and Beyond (HS&B) study, the 1987 and 1990 National Assessment of 
Educational Progress (NAEP) study, and the 1988 National Educational Longitudinal 
Study (NELS:88). The NAVE researchers will use survey and transcript data to analyze 
participation at a relatively detailed program level for the different groups and will 
examine changes in participation over time. Additionally, NA VE intends to use the 1990 
Schools and Staffing Survey (SASS) to examine the relationship between teacher 
characteristics and student demographics, in particular to examine the proportion of 
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■ special populations enrolled in various vocational classrooms. At the postsecondary 
g level, NAVE will use the 1987 and 1990 National Postsecondary Student Aid Studies 

■ (NPSAS) and the Beginning Postsecondary Students (BPS) databases. 

■ Although it is too early in the process of implementing the 1990 Perkins Act to 
assess the impact of recent initiatives on special populations, NAVE can assess to what 

■ extent schools and institutions have targeted federal funds to serve these students. The 
eight NAVE funding case studies investigated how local spending of federal vocational 

m education funds for secondary education changed under the new act, selecting four school 

■ districts that gained Perkins funds under the new requirements and four that lost funds. 
_ Specifically, these case studies examined how school districts concentrated their Perkins 

■ funds during 1991-1992 and 1992-1993 on sites or programs with high concentrations of 
special populations, what types of activities they funded, and how the uses of funds 

■ differed from spending under the 1984 Perkins Act. Site visitors asked about trends in 
local and state funding for vocational education and attempted to ascertain whether local 

■ and state funds substituted for the loss of Perkins funds or gains in Perkins funds 
substituted for those other funds. The funding case studies also asked about general 

M services provided for special populations and about how Perkins funding fit into the 

~ overall scheme for serving these groups. 

■ Although the funding case studies focused only on secondary education, NAVE is 
also conducting a national analysis of the distribution of Perkins funds for both secondary 

m and postsecondary education. Based on data submitted by the states, NAVE will 

compare how states distributed their Title II basic grant funds to school districts and 

■ postsecondary institutions under the old and new acts. Specifically, researchers will 
assess to what extent the new funding requirements were successful in concentrating 

B federal vocational education funds on areas with high numbers of special populations 

and, in particular, on inner-city areas. 

■ NAVE also conducted five tribal case studies focusing on Native Americans. 
— These case studies examined the effects of the federal legislation on tribal administration, 
| tribal expenditures for program improvement, the participation of Native American youth 

in vocational education programs and their access to high-quality programs, and the 

■ relevancy of tribal vocational education programs to local employment opportunities. 
NAVE researchers will assess the similarities and differences in implementation and 
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effects of the federal legislation in tribal and nontribal settings. In addition to the five 
field investigations, administrative information will be collected on the thirty-eight 
Perkins-funded tribal grantees under Section 103 of the act. 

NAVE will also analyze data from OVAE's specially targeted surveys of 
vocational education in adult and juvenile correctional facilities. However, since the 
surveys were not distributed until the spring of 1993, the information that will be 
available by time of reauthorization may be limited. 

Program Offerings 

As- discussed in "Describing Context and Trends," the national statistical surveys 
provide reliable information on the trends in nationwide enrollments in vocational 
education. NAVE, on the other hand, is particularly suited to ask about the factors 
influencing those enrollments. The local omnibus surveys, sent to administrators in 
secondary schools and districts and in postsecondary institutions, asked about overall 
enrollments, vocational education enrollments, changes in enrollments over time, and 
reasons why vocational enrollments either increased or decreased. At the postsecondary 
level, the surveys asked about enrollments in specific program areas. The local surveys 
also asked about vocational program offerings, the changes in program offerings over 
time, and the possible reasons for those changes. 

During the case studies, NAVE researchers delved more thoroughly into the 
possible reasons for changes in enrollments and program offerings as well as factors 
affecting program completion by asking several administrators and faculty at each site for 
their opinions about these trends. Site visitors asked administrators, vocational and 
nonvocational faculty, local business people, students and (at the secondary level) parents 
about their perceptions of the quality and usefulness of vocational education in their area 
and asked students why they chose or did not choose to participate in vocational 
education. While it is beyond the scope of NAVE to verify independently which factors 
influenced enrollments, the case studies provided the opportunity to determine whether 
similar perceptions were shared among a number of important providers and users of 
vocational education in a local area. 

Ongoing national surveys of the type discussed in "Describing Context and 
Trends" are not well-suited to provide information on new instructional methods and 
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other innovative program practices. However, by focusing on the implementation of 
current, federally supported vocational education initiatives, NAVE is able to investigate 
these concerns. The state-level omnibus surveys asked secondary and postsecondary 
vocational education administrators in the spring of 1992 about integration of vocational 
and academic education, teaching of all aspects of a given industry, implementation of 
performance measures and standards, Tech Prep, and school-to-work transition programs, 

9 

and efforts to coordinate with JTPA and other federal programs. 

At the local level, the omnibus surveys asked about the vocational curriculum, 
including the use of applied materials and courses, and about integration, performance 
measures and standards, Tech Prep, school-to-work transition, the extent of participation 
of business and labor, vocational student organizations, and local coordination with other 
federal programs. Specifically, the surveys asked what steps were taken to implement 
these practices, whether there had been an increase or decrease of effort under the new 
act, and how much the amount of assistance provided had changed. The case studies 
provided additional opportunities to assess implementation of these practices at the local 
level and included a study of vocational course materials for secondary vocational 
education. 
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NAVE will conduct a separate survey of VSOs, with particular attention to the 
participation of minorities in them. Although NAVE is able to investigate the extent of 
implementation of the various programs and practices early in the period of the new act, it 
is limited in its ability to determine the effects of changes on the quality of vocational 
education and on students. At most, NAVE was able to ask administrators and faculty 
about their perceptions of the effects of implementing a particular program or practice. In 
many cases, local professionals were only able to speculate on the effects or to provide 
anecdotal evidence since changes had been in place at most for one or two years at the 
time the surveys were distributed and the case studies were conducted in 1992 and 1993. 

In addition to NAVE, the 1990 Perkins Act.au thorized several other agencies to 1 
conduct studies of the implementation and effects of specific initiatives. Four separate 
studies are being done of performance measures and standards, and one longer-term 
evaluation is being done of Tech Prep. 
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Section 115 of the 1990 Perkins Act and the associated regulations require that 
each state board receiving funds under the act develop and implement a statewide system 
of core standards and measures of performance for secondary, postsecondary, and adult 
vocational education programs. This core set of measures and standards is to be used by 
recipients of Title II funds to evaluate annually the effectiveness of their vocational 
education programs. NCRVE has completed two studies, and is in the process of 
conducting a third, on this topic. The first study asked state-level administrators of both 
secondary and postsecondary vocational education about their plans for implementing the 
federal requirements approximately one year before the implementation deadline. This 
study helped NCRVE identify areas where states needed technical assistance. The 
second study followed up with the states to determine what performance measures and 
standards they actually implemented in the fall of 1992 and documented the various state 
approaches. 

Although the first two studies focused on implementation, NCRVE is also 
preparing to conduct a study of the preliminary effects of performance measures and 
standards systems on program practices and students. This third study will involve 
selecting four states that have made substantial progress in implementing their systems 
and conducting both local and state site visits in those states during 1993 and then again 
in 1994. By the fall of the second year of the study, vocational educators should have 
collected and reviewed two years worth of data and should be in the second cycle of 
program evaluations. Although it may still be too early to detect changes in student 
performance, the study should be able to ascertain whether the systems of performance 
measures and standards have led educators to develop and implement strategies for 
program improvement. 

OVAE will be conducting its own study of performance measures and standards, 
focusing on evaluating the soundness and the technical rigor of the measures and 
standards systems implemented by the states. The study will include the following three 
components: 

1. A detailed description of the status of each state's system of standards and 
measures developed under the act. 
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2. An assessment of the validity, predictiveness, and reliability of such standards and 
measures, unbiased to special populations, in the areas of academic achievement, 
vocational skill competencies, employment outcomes, and postsecondary 
continuation and attainment. 

3. An evaluation of the comparability of state-developed performance standards 
across states to establish a core of common indicators. 

The OVAE study will involve a mail survey to vocational education 
administrators at both the secondary and postsecondary levels in each state as well as nine 
site visits to states during 1994, including studies of three secondary and three 
postsecondary programs in each of the states visited. Although the implementation of 
performance measures and standards and their preliminary program effects should be 
well-documented by the time of reauthorization of the Perkins legislation, information 
about the effects on student performance will be limited. Future statistical surveys such 
as NAEP, NPSAS, and the longitudinal surveys should provide some indication of these 
effects. 

Title III Part E of the 1990 Perkins Act authorizes planning and demonstration 
grants to be awarded to consortia of school districts and postsecondary institutions for 
developing and operating four-year Tech Prep programs leading to a two-year associate 
degree or certificate. The Tech Prep initiative is intended to provide strong, 
comprehensive links between secondary schools and postsecondary institutions in a more 
systematic manner than previously. PES in OPP is conducting a five-year evaluation of 
the effectiveness of these programs. Beginning in 1993 and ending in 1997, the 
evaluation will describe the Tech Prep programs funded under the act, identify effective 
practices, and measure the progress of some Tech Prep students. The evaluation will 
involve surveys of state-level coordinators and local Tech Prep programs, in-depth 
examinations of selected local programs, a longitudinal survey of a sample of Tech Prep 
students drawn in the eleventh grade, and collection of school records data. The 
outcomes for Tech Prep students will be compared with those for a corresponding 
national sample of students. Only preliminary information will be available by the time 
of reauthorization of Perkins legislation in 1994 and 1995. 

Accomplishments 

NAVE will gather information on outcomes for students in vocational education 
from a variety of sources. Using NELS:88, NAVE researchers will link transcript data 
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with achievement test scores in an effort to determine academic outcomes and relate them 
to vocational coursetaking for secondary-level students. Unlike a similar analysis being 
conducted by the NCES using the 1990 NAEP, NELS:88 supplies gain scores (eighth to 
tenth grades and tenth to twelfth grades), allowing researchers to narrow the period 
during which change occurs and to isolate more effectively the causes of that change. In 
an effort to analyze outcomes for special education students, researchers will apply 
similar methods using the National Longitudinal Transition Study (NLTS). However, as 
discussed in "Describing Context and Trends," these efforts raise an important 
methodological issue: the difficulty of attributing performance on a standardized test to a 
single course or to a group of courses. Over the long term, careful work needs to be done 
to develop appropriate sequences or clusters of courses that can explain academic 
performance. 

NAVE will also examine employment outcomes of students in vocational 
education through several avenues. The Center on Educational Quality of the Workforce 
will conduct a study linking unemployment insurance and school data. The study will 
track the employment outcomes for former participants in vocational education at both 
the secondary and postsecondary levels in five states. In addition, NAVE will conduct a 
telephone survey of about 3,000 employers nationwide, asking about their involvement 
with local vocational education programs and about their satisfaction with newly hired 
employees. NAVE will also analyze employment outcomes for former students in 
vocational programs through the Survey of Income and Program Participation (SIPP). 
SIPP provides retrospective information on postsecondary vocational training and federal 
employment training for a cross-section of the U.S. population and links this information 
to current employment and income experiences. 

Personnel 

The NAVE omnibus surveys asked state-level administrators about the numbers 
and responsibilities of the professional staff who spend most of their time on vocational 
education and about the changes in those numbers and responsibilities from the last year 
under the 1984 Perkins Act to the first year under the new one. The local surveys asked 
about the numbers of administrators, teachers, and other professional and 
paraprofessional staff responsible for vocational education and about the changes in those 
numbers over time. The local surveys also asked whether coordinator positions existed 
for sex equity, Tech Prep, integration, and special populations. During the case studies, 



64 



NAVE researchers investigated the possible reasons for increases or decreases in the 
number of staff with vocational education responsibilities as well as the changing 
responsibilities of those staff. 

In addition to relying on the omnibus surveys and case studies, NAVE will also 
use several statistical databases to examine faculty characteristics such as demographics, 
qualifications, and experience. NAVE researchers will use the National Survey of 
Postsecondary Faculty (NSOPF) to study the characteristics of postsecondary vocational 
faculty and the Fast Response Survey System (FRSS) and SASS to study secondary 
vocational faculty. In addition, NAVE is using SASS to analyze faculty shortages. 
However, SASS provides information only on administrators' recent experiences with 
hiring vocational faculty. NAVE will not assess supply and demand independently, 
either through data on teacher training program enrollments and completions, industry- 
based employee interest in and qualifications for teaching, or state-level and institutional 
vocational program planning and hiring projections. Because of a delay in implementing 
the latest NSOPF, NAVE researchers will not be able to conduct a similar analysis of 
faculty shortages at the postsecondary level, and their descriptions of postsecondary 
vocational faculty characteristics will be based on data collected in 1987. 

Facilities and Equipment 

The only comprehensive study of vocational education facilities was part of the 
OPBE study conducted in 1977. This study included a discussion of the adequacy of 
facilities nationwide, examining the locations of institutions and instructional stations 
offering vocational education in comparison with population distribution and examining 
the size of institutions in terms of vocational enrollments and the number of shops, 
laboratories, and classrooms available to students. The OPBE study also included a 
discussion of the condition of facilities and their adequacy for serving physically 
handicapped students. However, information on these latter topics was based on 
institutional self-reports. The study did not verify independently the reliability of this 
information. The study also included a discussion of the utilization of vocational 
facilities, including the use of school-based facilities (i.e., during the regular school day, 
during alternate operating schedules, and during operating hours) and of community 
resources. The OPBE study did not include information on equipment used for 
vocational education. 
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Costs 

The old OPBE study included information on the factors affecting state policies 
for the financing of vocational education, on program funding models (including the 
types of allocation units and computation procedures used in each state), and on financing 
of facilities and equipment (including methods for distributing funds such as capital 
funding sources and funding mechanisms). The study also included a discussion of the 
limitations of the data for determining the direct impact of federal funds on the expansion 
of facilities and for determining the total amount of federal funds expended on facilities 
and equipment. 

The 1992 NCRVE study of education and training for work gathered up-to-date 
information on funding sources and mechanisms, including for each state the state-aid 
formula for general education funding; any student vocational education weight factors 
used in the state-aid formula; restrictions on the use of state funds; total vocational 
education funding; the percentage of funds coming from local, state, and federal sources 
(including tuition at the postsecondary level); and the percentage of Perkins funds 
allocated to secondary and postsecondary vocational education. However, information on 
total vocational education funding in the state and on the percentage of funds coming 
from local, state, and federal sources was based strictly on interviews with state-level 
administrators. The study did not describe how these administrators arrived at their 
estimates for funding nor was it within the scope of the study to verify the estimates by 
interviewing local vocational education administrators. 

The NAVE omnibus surveys asked state-level directors of vocational education 
about changes in funding for vocational education from the last year under the old act 
(1990-1991) to the first year under the new one (1991-1992), including the total operating 
budget for the agency or division and additional state and federal funds, and requested 
information on Perkins funds received, including Title II basic grants and Title III funds. 
The state-level surveys also asked administrators to estimate the total public expenditure 
for (secondary or postsecondary) vocational education in their state and to estimate what 
percentage of those funds came from various sources. The possible sources included 
general school district budgets, state vocational education funds, other state funds, 
Perkins funds, other federal funds, and other funds. However, almost twenty percent of 
secondary agencies (10 out of 56) and over forty percent of postsecondary agencies (20 
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■ out of 48) responding to the survey indicated they were not able to estimate the total 
_ public expenditure for vocational education in their states. 

In addition to asking about the amounts of funds for vocational education, the 

■ omnibus surveys also requested information on procedures and decision-making 
processes. Information was sought on how Perkins funds were split between secondary 

I and postsecondary vocational education, why local applications for Perkins funding were 

disapproved (if any were disapproved), what accounted for any major differences in the 
■j numbers of institutions receiving Perkins funds under the old and new acts, whether the 

• state developed a procedure for granting waivers on minimum grant amounts, and how 

_ the allocation of Perkins funds among school districts and postsecondary institutions 

| within the state was carried out. 

■ At the local level, the omnibus surveys asked questions about changes in school 
district budgets and postsecondary institution revenues and about the sources of those 

I funds. The surveys also asked about funds received under the different titles and sections 

of the 1990 Perkins Act and how Title II funds were being used. The surveys requested 

■ that administrators indicate whether various changes in the 1990 Perkins Act had a 

■ positive or negative effect on the implementation of vocational programs. 

■ The eight funding case studies provided NAVE researchers with the opportunity 
to delve more deeply into the impact of federal allocation requirements on the delivery of 

■ services at the local level for secondary vocational education. The sites included four 
school districts that experienced large increases in funding under the 1990 Perkins Act 

■ and four that experienced large decreases. The data gathered for these funding case 
studies were drawn from district budgets and enrollment records as well as from 

■ interviews with teachers, counselors, and administrators. Site visitors discussed with 
— school and district personnel the trends in funding for vocational education over the past 
m several years and into the future and the reasons for any increases or decreases. They 

■ also discussed the uses of local, state, and federal funds over the years and the ways those 
uses may have changed under the 1990 Perkins Act. 

The funding case studies attempted to assess what negative impacts there may 
I have been on districts losing Perkins funds, particularly on the special populations in 

those districts. Researchers investigated to what extent local and state funds substituted 
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for federal funds, possibly lessening the blow. Researchers also attempted to determine 
how the districts gaining Perkins funds spent their funds, whether they had a well-devised 
plan for implementing new services, and whether funds were targeted to special 
populations. 

The funding case studies attempted to estimate expenditures for vocational 
education at the district level. Although some districts maintained separate budgets for 
vocational education, most did not. Where those districts did not keep comprehensive 
expenditure information for vocational education, NAVE researchers estimated costs 
based on information collected from a variety of sources, including average teacher 
salaries for grades nine through twelve; the estimated full-time equivalent (FTE) for 
vocational faculty; administrator salaries and FTEs; and expenditures for facilities, 
equipment, and supplies. 

Finally, NAVE is conducting a study of the allocation of Perkins funds through 
the Education Finance Center. This study is examining the federal allocation of funds to 
the states as well as the within-state funding distribution. The aim is to determine 
whether Perkins funds were concentrated in areas with high numbers of economically 
disadvantaged students as intended by the 1990 Perkins Act. 

Summary of Data Availability 

The special studies conducted on the part of NAVE, OVAE, PES, NCRVE, and 
other federal agencies contribute breadth and depth to the information collected on 
vocational education at the national level. While filling in some of the obvious gaps left 
by the statistical surveys as discussed in "Describing Context and Trends," these studies 
also add texture to what is known about the vocational/technical enterprise. NAVE, in 
particular, represents an ambitious undertaking and promises to describe many aspects of 
current vocational education practices that are of concern to policymakers and program 
managers. Despite their comprehensiveness, the existing special studies are limited in 
their ability to describe program practices in a few areas. Some of these problems are 
shared among all agencies attempting to collect data on vocational education: 

• Providing comprehensive information on the interrelationships among the various 
boards and agencies responsible for vocational education and the institutions 
offering vocational education. 
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• Defining and identifying high-quality vocational programs. 

• Measuring learning outcomes. 

• Providing comprehensive information on the supply and demand of vocational 
faculty. 

• Assessing the condition of vocational facilities and equipment. 

• Estimating the costs of vocational education. 

• Providing timely information for reauthorization. 

Organization and Governance 

Although the NCRVE studies of education and training for work and strategies 
for linking planning and evaluation provide a strong starting point for understanding 
current state organization and governance structures for vocational education, the studies 
do not fully describe the interrelationships between the different responsible boards, 
agencies, and institutions in each state. Comprehensive information on the lines of 
authority and responsibilities for vocational education is necessary for understanding how 
state and federal policies for vocational education are implemented. Without 
comprehensive information on organization and governance, researchers, policymakers, 
and administrators are hindered in gathering complete information on vocational 
education and interpreting that information accurately. 

High-Quality Vocational Programs 

NAVE will collect a significant amount of information on the participation of 
special populations in vocational education and on vocational program offerings through 
a variety of data collection methods. However, NAVE's ability, as well as the ability of 
the statistical surveys discussed in "Describing Context and Trends," to assess 
participation in and availability of high-quality vocational programs is limited by the lack 
of definition of such programs. In what ways do high-quality programs differ from high- 
status programs? Should high-quality programs be defined at a local, state, or national 
level? Should they be defined in terms of their level of technology (i.e., "high tech" 
versus "low tech" programs), their expected long-term labor market outcomes, the level 
of occupationally or academic specific learning they produce, or the types of learning 
they engender (e.g., integrating vocational and academic education, teaching all aspects 
of a given industry, or providing a Tech Prep education)? Until some sort of consensus is 
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achieved about what constitutes high-quality vocational programs, special studies (as well 
as the statistical surveys) will be limited in their ability to assess to what extent programs 
are providing high-quality vocational education across the nation and whether special 
populations have equal access to that education. 

Learning Outcomes 

Current special studies are limited in their ability to provide information on the 
learning outcomes of students participating in vocational education. As mentioned 
previously, NAVE will attempt to link achievement test scores to coursetaking patterns 
for secondary-level students using statistical surveys included in the discussion in 
"Describing Context and Trends." However, achievement tests are generally not 
available at the postsecondary level, and the statistical surveys do not provide information 
on occupational competencies, to a large extent because appropriate assessment 
instruments are not widely available. 

Faculty Supply and Demand 

NAVE will provide partial information on the supply and demand of vocational 
faculty. By analyzing SASS data, NAVE researchers will be able to describe 
administrators' experiences with hiring vocational faculty at the secondary level. 
However, NSOPF data will not be available for similar analysis at the postsecondary 
level. Furthermore, this type of analysis provides only part of the picture. Other sources 
of information include teacher training program enrollments and completions, industry- 
based employee interest in and qualifications for teaching, and institutional and state- 
level vocational program planning and hiring projections. 

Facilities and Equipment 

The only comprehensive study of vocational education facilities was conducted 
by OPBE in 1977, and this study based its analysis of the condition of facilities on 
institutional self-assessments using broad categories such as "in good condition," "in 
need of minor maintenance," "in need of major maintenance," and "in need of 
replacement." Furthermore, the study did not include an assessment of the equipment 
used for vocational education. The information available for special studies from the 
statistical surveys is also limited. 
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Cost of Vocational Education 

Although providing useful information on local uses of Perkins funds and state- 
level funding mechanisms, existing special studies are not able to provide accurate 
information on the cost of vocational education nationally, largely because the 
information is not readily available. While states are able to provide information on the 
level of Perkins funds and any targeted state funds they distribute to local school districts 
and postsecondary institutions, they are less able to provide reliable information on local 
expenditures for vocational education. Furthermore, local school districts and 
postsecondary institutions generally do not maintain a separate budget for vocational 
education. Although these districts and institutions track Perkins funds and targeted state 
funds, they can only estimate total expenditures for vocational education. A reliable 
estimate of what is spent nationally must be based on a consistent estimating 
methodology. Although the eight NAVE funding case studies provide a starting point for 
determining the cost of vocational education, the case study sample size is too small to 
produce an accurate national estimate and would only do so for secondary vocational 
education. 
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Timing 

The existing special studies will be unable to provide information on some 
questions in time for reauthorization of Perkins legislation in 1994 and 1995. Because of 
problems with data availability, NAVE may not complete its analysis of vocational 
education in adult and juvenile correctional facilities by that time, and the Center on 
Educational Quality of the Workforce may not complete its study of employment 
outcomes. The newest NSOPF data on postsecondary faculty will not be available in 
time to even begin analysis before reauthorization. Furthermore, although the NAVE 
studies of participation in vocational education are based on the most recent available 
statistical datasets (1982 HS&B, 1987 and 1990 NAEP, the 1990 year of NELS:88, 1990 
SASS, 1987 and 1990 NPSAS, and the 1990 year of BPS), none of these provides 
information on the time period of the 1990 Perkins Act, which took effect during the 
1991-1992 academic year. Finally, PES will not conclude its study of the effectiveness 
of Tech Prep until 1997. 

To a large extent, the problem of timing is unavoidable. Because of the 2+2 
nature of Tech Prep, and because of the time needed for implementing the program and 
assessing labor market outcomes, data on program effectiveness will not be available 
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within the five-year authorization cycle. Because of the periodic nature of the national 
statistical surveys, and the time required to plan and conduct the surveys and analyze the 
data, the most recent datasets able to produce results in time for reauthorization were 
conducted just prior to implementation of the 1990 Perkins Act. However, NAVE and 
the other special studies will provide rich information on the implementation of the latest 
Perkins legislation while leaving an assessment of the impact on outcomes to future 
surveys and studies. 

In summary, special studies provide the opportunity to answer many important 
questions about vocational program practices that are left unanswered by the national 
statistical surveys. The data collection activities described in the next two sections 
provide additional sources of information, particularly on vocational education at the 
local and state levels. 



MONITORING PROGRAM COMPLIANCE 

Purposes of the Data 

The agencies overseeing the implementation and administration of federal policy 
for vocational education are responsible for monitoring whether local and state recipients 
of federal funds are in compliance with various federal requirements. Such agencies 
monitor the distribution and uses of Perkins funds, review and approve state plans for 
vocational education, ensure that federally protected populations are served equitably, 
and track and assist with problems encountered in implementing federal law and 
regulations. At the federal level, the Office of Vocational and Adult Education (OVAE) 
has the primary responsibility for compliance-monitoring functions; and at the local and 
state level, these responsibilities are parceled out through a variety of administrative 
arrangements. 



Data Collection Methods 

What most distinguishes the compliance-monitoring function from describing 
context and trends and program practices is that the information supporting this function 
must be maintained (although not necessarily reported) by all those who are accountable. 
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While the actual collection of data to assess compliance may rely on sampling 
techniques, data must be maintained by the universe of recipients of federal funds. Thus, 
for example, all school districts, postsecondary, and state institutions receiving Perkins 
funds must maintain data on the distribution and uses of those funds, although in any 
given year, only a few may undergo an audit of this information. 

While data describing context and trends and program practices are intended to 
produce an overall picture of vocational education nationally, data collected for 
compliance purposes are generally intended to describe the actions of individual 
recipients. Ongoing, national surveys generally do not produce reliable statistics on 
states or individual schools and institutions. In contrast, compliance data is designed to 
enable the monitoring agencies to identify particular schools, institutions, and states that 
are not meeting their federal obligations. 

Because monitoring compliance generally requires collecting and maintaining 
data by the universe of recipients, its requirements can be extraordinarily costly and 
burdensome. Extreme care must be taken in defining the parameters of data needed for 
this function as well as the extent to which states and locals will be required to report 
information rather than simply maintain it. 

Existing Data Collection Activities 

OVAE is the primary federal agency responsible for monitoring compliance of 
recipients of Perkins funds with the provisions of the legislation. OVAE staff engage in a 
number of monitoring activities involving local school districts, institutions, and states. 
The agency maintains information on the distribution of Perkins funds to the states and 
expects states to account for the distribution of Perkins funds to local recipients. OVAE 
also approves each state plan for vocational education and keeps records of them. 
However, the information contained in the state plans is maintained separately for each 
state and does not constitute a database. 

In addition to federal monitoring of state compliance, the 1990 Perkins Act 
expects state boards for vocational education to monitor local recipients to assure their 
compliance with the provisions of the act. The act specifically requires these boards to 
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provide assurances in their state plans that they will conduct adequate monitoring of how 
well local recipients are meeting the needs of special populations. While engaging in a 
number of monitoring activities, state boards are also responsible for approving local 
applications for Perkins funds and for maintaining those applications at the state level. 

The Office of Civil Rights (OCR) enforces the Guidelines for Eliminating 
Discrimination and Denial of Services on the Basis of Race, Color, National Origin, Sex 
and Handicap in Vocational Education Programs (34 CFR, Part 80, Appendix B). 
Issued in 1979, the guidelines require state vocational education agencies to develop their 
own civil rights compliance programs. Each agency must collect and analyze data 
annually on participation in vocational education for each facility receiving federal funds, 
conduct compliance reviews during a five-year cycle, provide technical assistance upon 
request, and submit periodic reports to OCR. OCR also produces a biennial Elementary 
and Secondary School Civil Rights Compliance Report for which it surveys a sample of 
schools nationwide. For the first time, the 1992 survey will include several hundred 
vocational education schools identified in the Common Core of Data (CCD). 

Pursuant to the Deficit Reduction Act of 1984, federal legislation established the 
Federal Income Verification System (FTVS), requiring each state to provide wage record 
data to verify the eligibility of applicants for Aid to Families with Dependent Children, 
Medicaid, Food Stamps, Child Support Enforcement, and other federal programs. Most 
states responded to the legislation by setting up a wage report system, housed in their 
state's employment security agencies, which collect wage record information four times a 
year from most employers in the state. Although FTVS was set up for purposes unrelated 
to vocational education, wage record data is being used in many states to determine the 
employment outcomes of former participants in vocational/technical programs. 

The following list summarizes the compliance-related data collection efforts: 
Office of Vocational and Adult Education ( OVAE) 

• Record of distribution of Perkins funds to states 

• State plans 
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State Vocational Education Boards 

• Record of distribution of Perkins funds to local recipients 

• Local applications 

Office of Civil Rights (OCR) 

• Vocational education civil rights compliance programs 

• Elementary and Secondary School Civil Rights Compliance Report 

State Employment Security Agencies (SESAs) 

• Wage record information 



Description of Available Information 

Although compliance data is collected for highly specific, usually legislated 
purposes, they are a potentially valuable source of general information for policymakers 
and vocational educators. As stated in the introductory chapter, the four functions of data 
on vocational education discussed in "Describing Context and Trends," "Describing 
Program Practices," "Monitoring Program Compliance," and "Monitoring Program 
Performance" are not mutually exclusive. Data that serves one function can be useful in 
another, and data collected for all four functions can be used to establish federal policy 
and to manage programs. The following sections describe the information on the seven 
primary questions concerning vocational education that is available from data collected 
for compliance monitoring purposes. 

Organization and Governance 

OVAE maintains some information on the governance of vocational education in 
each state through the state plans. The state plan must identify the designated board for 
vocational education in the state as well as describe how the board delegates its functions/ 
Although the designated state board is the sole agency responsible for administering the 
state's vocational education program, the 1990 Perkins Act allows the board to transfer 
many of its responsibilities to more appropriate state agencies responsible for actually 
implementing vocational education at the secondary and postsecondary levels. However, 
the amount of detail provided in the state plans on the roles and responsibilities of each 
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agency and board involved in administering vocational education varies from state to 
state. 



Student Participation 

The state plans for vocational education and local applications for funds describe 
how recipients will ensure equal access for special populations to the full range of 
vocational education programs and activities, including high quality vocational programs. 
Local applications also contain the number of individuals enrolled who are members of 
special populations and describe how the needs of these individuals will be assessed and 
met. Although these plans and applications provide information on local and state 
intentions to serve special populations and the varying methods for doing so, they do not 
provide information on actual implementation or effects. Revised and resubmitted on an 
annual basis, the state plans are required to describe the progress that has been made in 
achieving the goals described in previous state plans. 

As part of their civil rights compliance programs, state vocational education 
agencies collect data annually on vocational students by race/ethnicity, limited-English 
proficiency, sex, and handicap. However, because the compliance programs were 
designed independently by each state, the specific data that are collected by the states 
vary. For example, some states collect data on total enrollment in vocational education 
by facility, while others collect enrollment data for each occupational program in the 
facility. Some states compare the incidence of special populations in the general service 
area with the incidence of these populations in vocational/technical programs, while 
others do not make any extra-facility comparisons. Consequently, the data collected to 
fulfill civil rights compliance requirements are not comparable across states. 
Furthermore, since data collection is the responsibility of each state, not OCR, this data 
does not constitute a database. Finally, civil rights compliance does not require that 
states collect data on other special populations receiving emphasis in the 1990 Perkins 
Act — specifically, economically or academically disadvantaged students, other than those 
with limited-English proficiency, or incarcerated individuals, or other targeted 
populations such as adults in need of training and retraining, single parents, and displaced 
homemakers. 



The Elementary and Secondary School Civil Rights Compliance Report published 
biennially by OCR includes enrollment data on sex, race/ethnicity, limited-English 
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proficiency, disabled status, and specific disability for a sample of schools nationwide. In 
addition, the survey requests various combinations of these demographic 
characteristics — for instance, the number of LEP students enrolled by sex, race/ethnicity, 
and disabled status. Beginning with the 1992 survey, OCR will publish enrollment data 
for a sample of vocational education schools. However, since the sample is based on the 
CCD, the survey will be subject to the same limitations regarding the CCD as described 
in "Describing Context and Trends The survey will also not provide program-level 
information. 



Program Offerings 

Each state board receiving 1990 Perkins Act funds was required to conduct an 
assessment of vocational program quality using criteria that encompassed a broad range 
of program characteristics, including the extent of integration of vocational and academic 
education, sequential courses of study, linkages between secondary and postsecondary 
educational institutions, instruction and experience in all aspects of a given industry, 
relevance of programs to the workplace and to specific occupations, and basic and higher- 
order competencies. Consequently, each state plan describes the results of these 
assessments and the ways the states propose to use their Perkins funds to address the 
needs revealed through the assessments. 



The local applications describe how local recipients propose using Perkins funds 
to integrate vocational and academic education, develop coherent sequences of courses, 
provide a Tech Prep education, provide supplementary services for special populations, 
develop apprenticeship programs, tie programs to economic development efforts, and 
train students in all aspects of a given industry, among other uses. However, as stated 
previously, these plans and applications provide information on local and state intentions 
rather than on actual implementation or effects. 
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The Elementary and Secondary School Civil Rights Compliance Report published 
biennially by OCR will provide information on the status of special education and LEP 
programs in vocational schools; on enrollment in advanced placement courses in math, 
science, and computer science; and on high school completion. However, as mentioned 
previously, the report will not provide information on enrollment in specific occupational 
programs. 
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Accomplishments 

The vast majority of states collect wage reports from employers on a quarterly 
basis through their SESAs. Wage reports generally include the social security number 
and total wages earned for each employee during the quarter. SESAs usually maintain 
five quarters of wage record information in their active files. State agencies responsible 
for administering vocational education, employment training, and other educational 
programs have begun to tap this database as a source of information on the employment 
and earnings outcomes of former program participants. 

In their basic form, wage record data provides a rough look at the employment 
status and level of earnings of former participants in vocational/technical education. 
However, the data must be supplemented in order to provide more comprehensive 
outcomes information. First, while collecting industry information from each employer, 
most wage reports do not indicate the occupation in which an employee works. 
Vocational educators who are interested in the relatedness of employment to training 
either supplement the wage record data with an employer survey requesting occupational 
information or estimate the likelihood that an employee working in a particular industry 
is employed in an occupation related to training, based on industry/occupation matrices 
developed by the federal Bureau of Labor Statistics and its state counterparts. Second, 
while covering the majority of employers in a state, wage record systems exclude certain 
types of employers and employment. Vocational educators who wish to increase the 
likelihood of locating former program participants supplement SESA wage record data 
with data on military enlistment, state and federal civilian employment, enrollment in 
higher education, and employment in adjacent states, among other sources of 
information. Other technical issues must also be addressed when using wage record data. 
The National Occupational Information Coordinating Committee (NOICC) will be 
publishing a guide to using wage record data for follow-up purposes by the end of the 
summer of 1993. 

Personnel 

The state plans describe how each state vocational education agency will provide 
programs for personnel and curriculum development. The local applications describe 
how Perkins funds will be used to provide inservice training of both vocational and 
academic instructors for integrating vocational and academic education. At the 
postsecondary level, local applications describe mentor programs for individuals 
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employed in business and industry who are interested in becoming classroom instructors 
or for vocational educators wishing to upgrade their teaching competencies. 

As part of their civil rights compliance programs, most state vocational education 
agencies collect data annually on vocational faculty by sex and race/ethnicity. The 
Elementary and Secondary School Civil Rights Compliance Report will provide 
information on the demographics of teachers in vocational schools and will provide 
comparisons with nonvocational schools. 

Facilities and Equipment 

Compliance data provides very little information on facilities and equipment. 
However, local applications describe how recipients will use Perkins funds to purchase 
equipment, including instructional aids, and to adapt equipment. 

Costs of Vocational Education 

Although not collected in a central database, information on the distribution and 
expenditures of Perkins funds is maintained by the various recipients of those funds. 
OVAE maintains information on the federal distribution of funds to the states; state 
boards for vocational education maintain information on the distribution of Perkins funds 
to local recipients; and local school districts and postsecondary institutions maintain an 
accounting of the expenditures of the funds they receive. Furthermore, OVAE has 
information on the proposed uses of state funds contained in the state plans, and the state 
boards for vocational education have information on the proposed uses of local funds 
contained in the local applications. 

Summary of Data Availability 

The data collected for compliance purposes is generally dictated by federal 
legislation and, as such, is sufficient for meeting their intended purposes. However, this 
d&ta is also a potential source of valuable information for researchers, policymakers, and 
vocational educators. In this context, the primary problem is inaccessibility. Although 
federal law or policy may sometimes restrict access to the data, its inaccessibility stems 
more from a lack of understanding on the part of the responsible agencies in regards to 
th^ usefulness of this data for forming vocational education policy and for managing 
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vocational programs and from a lack of knowledge on the part of potential data users of 
its availability. 

However, a real limitation of using the data for other than its intended purposes is 
that it is not always collected in a single, central location or does not constitute a 
database. While collected centrally by the states and OVAE, the local applications and 
state plans are maintained separately on paper for each recipient of Perkins funds. A 
complete picture of the distribution of Perkins funds to local recipients requires gathering 
information from each of the states, and a complete picture of the expenditures of Perkins 
funds requires gathering information directly from local recipients. (As discussed in 
"Describing Program Practices," the NAVE is conducting a study of state allocations of 
Title II funds to local recipients and gathering information from a sample of local 
recipients on the general uses of Perkins funds, although not the amounts allocated for 
each use, through the omnibus surveys.) The data collected for state vocational education 
civil rights compliance programs is sometimes part of state vocational education 
databases, but the extent of data automation varies by state; and in some cases, data for 
civil rights compliance purposes is kept separately from the mainstream of vocational 
education data. Wage record information constitutes a database in the majority of states. 
Perhaps the most centrally kept compliance data is part of the biennial Elementary and 
Secondary School Civil Rights Compliance Report issued by OCR, although this data 
describes a sample of vocational schools rather the universe and covers only secondary 
vocational education. 

In summary, compliance data provides a potentially valuable source of 
information on vocational education, particularly for those policymakers and program 
managers interested in the status of vocational education at the local and state levels. 
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MONITORING PROGRAM PERFORMANCE 



■ Purposes of the Data 

a What does vocational education accomplish? Educators and policymakers at all 

■ levels ask this question. They are interested in a variety of program outcomes including 
what kinds of occupational and academic skills students acquire through vocational 

g programs, how many students pursue further education and training, how program 

participants fare in the labor market, and how well programs respond to short- and 

I longer-term demands for different types of labor and mixes of skills. To answer these 

questions, local and state educational agencies and institutions have developed and 

■ continue to refine a variety of data systems designed to yield information on how well 

• vocational education is performing. These systems include occupational information 
mm systems providing data on labor market demand and supply, management information 
m systems providing program data on students and faculty, and recently enacted 

accountability systems establishing outcome-based performance measures and standards 
a for secondary and postsecondary vocational programs. 

■ It is essential to understand that the primary purpose of these performance 
monitoring systems is local and state program improvement: helping local and state 

■ educators respond more effectively to the needs of students and the marketplace. To this 

* end, the systems must reflect the diversity that characterizes vocational education by 
mm adapting to local and state needs and circumstances. 

This emphasis on local and state program improvement means that the systems 
| vary substantially from locality to locality and state to state. Precisely what is collected, 

when, and how often varies because systems are designed to meet local and state 
I objectives, as well as to conform to local and state systems of governance and operation 

of the entire educational enterprise. Consequently, these systems are usually not well- 

■ suited to providing uniform national data on program performance. Because definitions 
and methods of collection vary, local and state systems cannot yield information that can 

■ be aggregated across states to produce national estimates on the performance of 

■ vocational education. Any effort to impose greater comparability and uniformity on these 
mm systems risks undermining the primary purpose of these systems, which is to provide 

■ locals and states with a powerful tool for monitoring and assessing the effectiveness of 
their particular vocational education programs. 
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Nevertheless, national estimates of program performance are certainly desirable; 
and over the long run, Congress will want evidence that the policies it promotes are 
producing the desired effects on students* occupational and academic attainment and on 
their success in the labor market. Such data, however, will best come from other 
sources — for example, from the national longitudinal surveys and special studies. 

Consequently, the role of the federal government in developing data that will 
serve to improve local and state programs lies not in developing national data systems per 
se but rather in monitoring the efforts of locals and states to develop systems and in 
providing appropriate technical assistance. Historically, Congress has adopted this 
approach in encouraging states to develop and implement state occupational information 
systems. This strategy should also guide the development of the federally required 
accountability systems as well as other efforts to strengthen program management 
information. Where uniformity and comparability do not seriously conflict with local and 
state objectives, they should be encouraged. However, the requirements of local and state 
program improvement should dictate system design, not the desire for statistically 
rigorous national estimates. 



Data Collection Methods 

As long as curriculum content and program operations remain a local and state 
responsibility, the design of data systems aimed at monitoring and improving program 
performance should remain a local and state activity. Federal policy may, of course, offer 
guidance and establish general topics that should be included in such systems. The 
federal government can also provide generic definitions, examples of operational 
strategies, and assistance with the technical aspects of system design and program 
evaluation. In the final analysis, however, the design and maintenance of these systems is 
up to local and state agencies and institutions. 

Probably the single most important methodological feature that the federal 
government could promote is the adoption of data systems based on individual student 
and faculty records, that is, systems in which information about students and faculty is 
collected and stored for each individual. Such an approach permits almost any kind of 
data aggregation and maintains the most flexibility for analysis. 
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Nevertheless, some states will resist systems built around individual records. 
Despite the dramatic decreases in the costs of data storage and data processing, systems 
based on individual records can still be costly and complex. Some states reject such 
systems on philosophical grounds, believing that individual records invite invasion of 
privacy and other undesirable consequences. Consequently, it will be some time before 
all states develop and maintain individual record systems for monitoring secondary and 
postsecondary vocational education performance. Some states will continue to collect 
and report information at a higher level of aggregation such as the classroom, program, 
institution, or local education agency. 

Left to their own devices — albeit with federal guidelines and technical 
assistance — locals and states will adopt a wide variety of methods for collecting and 
using data to monitor program performance. These diverse strategies should not cause 
concern for federal policy as long as other strategies are developed for obtaining national 
estimates of program outcomes. 



Existing Data Collection Activities 

Efforts to collect data for monitoring program performance consist of three major 
activities: (1) occupational information systems, (2) management information systems, 
and (3) accountability systems of performance measures and standards. Each of these is 
briefly reviewed below. 



Occupational Information Systems 

Occupational Information Systems (OIS) are computerized databases containing 
occupational and labor market information designed to help states meet the occupational 
information needs of various vocational education and training programs. 3 Established 
by Congress in 1976, State Occupational Information Coordinating Committees 
(SOICCs) have developed their own OIS programs with financial and technical support 
from the National Occupational Information Coordinating Committee (NOICC). 
Gathering information from a variety of sources, OIS programs generally include current 



3 The term OIS will be used to refer to both an Occupational Information System (singular) and 
Occupational Information Systems (plural). 
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and projected demand for workers by occupation and information on the supply of 
graduates from related training programs. Some systems contain information on the 
working conditions, educational requirements, wages, and benefits of specific 
occupations as well as information about training programs, educational institutions, 
industries, and employers in the state. OIS programs can provide information on 
occupational supply and demand statewide as well as for substate regions. 

Management Information Systems 

Most state agencies with responsibility for vocational education possess a 
Management Information System (MIS) containing data on students and faculty in 
vocational education. 4 These systems vary widely in their organization, level of 
automation, and content. While most states maintain separate systems for secondary and 
postsecondary vocational education and for vocational and general education at each 
level, some states have developed integrated MIS databases. Most states have some 
capacity for data automation at the state level, although very few have direct, on-line 
linkages with local secondary educational agencies and postsecondary institutions. 
Capacity for data automation varies even more widely at the local level, particularly at 
the secondary education level, with a number of local educational agencies nationwide 
still maintaining data in the form of paper records. Although an in Teasing number of 
states are developing automated student record systems, about half of the vocational 
agencies at both the secondary and postsecondary levels do not possess this capacity. 
States vary in the level of aggregation at which they collect data from local providers as 
well as in the specific information elements they request. Appendix B describes the 
findings from the site visits conducted for this study regarding varying local and state 
MIS practices. 

State-level vocational education administrators use MIS data in a variety of ways: 
(1) to prepare annual performance reports submitted to the Office of Vocational and 
Adult Education (OVAE); (2) to conduct program evaluations, generally on a five-year 
review cycle; (3) to distribute state vocational education funds in those states with 
targeted funds; (4) to respond to compliance requirements from the Office of Civil Rights 
(OCR); and (5) to respond to ad hoc requests for information from various sources, 
including executive and legislative offices in the state. // 

4 The term MIS will be used to refer to both a Management Information System (singular) and 
Management Information Systems (plural). 
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At the local level, many school districts (especially larger ones) and 
postsecondary institutions have their own MIS. These systems may be maintained 
separately for vocational and general education or may constitute an integrated database. 
Local providers of vocational education use MIS data primarily to conduct their own 
periodic program reviews and to respond to state- and national-level requests for 
information. 



OVAE is in the process of developing a national-level MIS that will include data 
collected from each of the states. Currently, OVAE is the federal recipient of the states' 
annual performance reports for vocational education; however, these reports do not 
constitute a database. The new MIS will maintain an automated record of a limited 
number of data elements submitted by each state, and will be used by OVAE primarily to 
assist states in managing and improving their vocational programs. The data submitted to 
OVAE by the states will generally be drawn from state-level MIS databases. 



Performance Measures and Standards Systems 5 

The Carl D. Perkins Vocational and Applied Technology Education Act of 1990 
requires states to develop accountability systems that include performance measures and 
standards for secondary and postsecondary vocational education programs. These 
systems are to include at least two sets of performance measures. One set must measure 
learning and competency gains, including student progress in the achievement of basic 
and more advanced academic skills. The other set must measure any one of the 
following: (1) competency attainment; (2) job or work skill attainment; (3) retention in 
school; or (4) placement in further education, the military, or employment. These 
systems must also include appropriate adjustments and incentives for encouraging 
services to students with special needs. Local recipients and states may supplement these 
minimal requirements with additional measures, and local recipients may modify 
measures and standards to reflect local demographic or economic conditions. 
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Most states want to go well beyond the minimum requirements of the 1990 
Perkins Act. They recognize that limiting their systems to just two measures and 
standards would unwisely displace a number of other important goals of vocational 



5 This section draws heavily on E. Gareth Hoachlander, Karen Levesque, and Mikala Rahn's (1992), 
Accountability for Vocational Education: A Practitioner's Guide. Interested readers are advised to 
consult this guide for a more detailed treatment of the topics covered in this section. 
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education. The four optional goals are equally important, although states need choose 
only one to comply with the minimum requirements of the 1990 Perkins Act. Yet, in 
excluding three options from consideration, states might imply that these outcomes no 
longer mattered or that their importance had considerably diminished. Consequently, 
many states are planning to incorporate all five measures outlined by the 1990 Perkins 
Act — and in some cases even more measures — in their accountability systems. 

As of this writing, all of the states have developed and begun implementing 
systems of measures and standards for secondary and postsecondary vocational education 
programs. These systems generally overlap with their MIS. Implementation began in fall 
1992, and all states at least nominally responded to the minimum requirements of the 
1990 Perkins Act for two sets of measures and standards, with most states exceeding 
these minimums (Rahn, Hoachlander, & Levesque, forthcoming). Whether, in fact, the 
states' measures and standards are appropriate will be the subject of a Congressionally 
mandated study of the states' responses to the accountability requirements of the 1990 
Perkins Act. The study, conducted through OVAE, will examine the validity and 
reliability of measures and standards adopted by the states and also assess the degree of 
comparability and uniformity that exists among state systems. The department will report 
its findings to Congress by September 1994. 

In developing their systems of measures and standards, states have adopted 
widely varying approaches. Some states have taken a centralized approach to designing 
their measures, prescribing the specific assessment instruments or data collection 
procedures to be used by local recipients, while others have taken a decentralized 
approach, allowing local recipients to choose the specific instruments or procedures. Still 
other states have adopted a mixed approach, prescribing the requirements on some 
measures and allowing flexibility on others. The extent of centralization generally 
depends on the availability of assessment instruments and the pre-existence of statewide 
procedures for monitoring vocational program performance. Some states will collect 
local performance data through a central state office, while others will leave data 
collection and analysis primarily to local recipients. The comparability of information 
generated by the systems of performance measures and standards will be complicated by 
the diversity of approaches taken by the states. 
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Description of Available Information 



The following sections describe the types of information that are available 
through the above-mentioned data systems. While the primary purpose of data describing 
program performance is local and state program improvement, this data may be useful for 
informing other policy and program management questions. 

Organization and Governance 

Most states operate a State Training Inventory (STI) as part of their OIS. The STI 
contains information on the schools offering vocational education and training programs 
in that state and can generate a list of the specific programs offered by each institution 
and in each geographical area in the state. A national database maintained by NOICC 
consolidates the information compiled in each state. Although containing information on 
thousands of schools and institutions offering vocational education nationwide and tens 
of thousands of vocational programs, STI databases depend on the voluntary participation 
of secondary and postsecondary education agencies and consequently do not constitute 
the universe of vocational education providers. 

State-level MIS for vocational education are generally able to provide the number 
of local education agencies and postsecondary institutions offering vocational education 
in a state. However, depending upon the organization of vocational education in a state 
and the scope of a state's MIS, these systems may contain information only on Perkins- 
funded programs and institutions. Vocational education that is supported wholly through 
local and state funds may not be included in these systems. Piecing together a 
comprehensive picture of vocational education in a state may require gathering 
information from several different databases and agencies. Information on nonfederally 
funded vocational education may not be readily available. The annual performance 
reports submitted to OVAE usually include a description of the types of secondary 
schools and postsecondary institutions offering vocational education in a state, but, on e 
again, may only include federally funded providers. 

Student Participation 

State-level MIS exhibit varying capacities for identifying special populations. 
Most systems can tally the number of students enrolled in vocational courses or 
completing vocational programs by sex and race/ethnicity; but generally, only those 
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systems with automated student records are able to produce these statistics for other 
targeted groups. State agencies that collect data aggregated at the school or institution 
level may be able to report the number of special population students participating in 
vocational education overall but not the numbers participating in specific occupational 
programs. 

One problem is that some data collection procedures developed under the 1984 
Perkins Act did not request program-level information for all special population groups. 
The 1984 Perkins Act required funding set-asides for six groups: (1) handicapped 
students, (2) disadvantaged students, (3) adults in need of training and retraining, (4) 
single parents and homemakers, (5) students in programs designed to eliminate sex bias 
and stereotyping in vocational education, and (6) criminal offenders. In some states, data 
collection focused on counting the total number of students in each of the groups who 
were served by set-aside funds rather than the numbers of these students participating in 
the various occupational programs. State MIS are beginning to change in response to the 
1990 Perkins Act priorities, attempting to collect program-level data for handicapped, 
economically disadvantaged, academically disadvantaged, and LEP students. However, 
change is often slow, especially when modifying the data collection procedures of dozens 
of local vocational education systems is involved. 

While local recipients are able easily to count the number of students served by 
programs targeting special populations such as programs for single parents, displaced 
homemakers, and single pregnant women, many local recipients do not have the capacity 
to identify these students in the general population of the school or institution or in the 
context of general vocational course enrollment. Without being able to identify which 
students belong to the various special populations, even automated student record 
systems cannot produce occupational program-level information for these groups. 

Although the Perkins legislation and associated regulations offer definitions for 
the various special population groups, these definitions do not always translate directly 
into procedures for identifying and classifying individual students. For example, the 
Perkins regulations define an individual with disabilities as "any individual with any 
disability as defined in ... the Americans with Disabilities Act of 1990" (U.S. Congress, 
1992). Generally, vocational educators at the secondary level classify any student who 
has an Individualized Education Program (IEP) as an individual with disabilities. At the 
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postsecondary level, however, the process is more complex. Knowledge of a student'^? 
handicap status may come from several sources, including student declaration of 
disability on an application form, a referral from a vocational rehabilitation or other 
agency, or a voluntary assessment conducted by the institution. Some postsecondary 
institutions may use all of these and other sources of information to identify handicapped 
students, while others may rely primarily on one or two sources. Although some states 
provide guidelines for local recipients to use for identifying the Various special 
populations, few monitor local procedures closely; and still others rely strictly on the 
definitions provided in the act and regulations. • ' \- 

Local vocational educators generally review the participation of students by sex 
and race/ethnicity during their program review process, usually conducted on a five-yeat? 
cycle. Some local systems also regularly examine the participation of handicapped and 
LEP students, two of the groups included in OCR compliance programs. During the* 
program review process, local vocational educators may compare the participation rates 
of these groups across occupational programs to see whether any programs enroll 
unbalanced numbers of these populations and to develop strategies for recruiting and 
retaining students. 

OVAE plans to gather data from the states on the enrollment and completion of 
all special populations mentioned in the 1990 Perkins Act, for vocational education 
overall, and for specific occupational programs. Although some states will not be able to 
provide all of this information, OVAE's MIS will include all available data. 

Most state performance measures and standards systems will include data on 
special populations. About half of the states have developed specific measures at each of 
the secondary and postsecondary levels for special populations in the areas of enrollment 
and access, retention and completion, and placement. However, only about half of the 
states will be able to disaggregate data on special populations for all their measures 
during the first year of implementation. j 

» 

r 

Program Offerings 

OIS contain data on the number of recent graduates of vocational education and 
training programs in a state. Data on these program completers is maintained by 
program, by type of institution, and by substate region. This data is usually supplied to 
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SOICC from state MIS databases by the various state agencies offering vocational 
education. 

Most state MIS databases contain information on vocational program completers. 
At the postsecondary level, data collection is driven by the Integrated Postsecondary 
Education Data System (IPEDS) requirements, which direct institutions to report the 
number of students completing certificates and degrees by vocational program area at the 
six-digit CIP level. For secondary education, program completion detail varies from the 
two- to six-digit CIP level. Some states employ their own program classification 
schemes, although many have developed crosswalks to the CIP for submitting data to 
OVAE in the annual performance reports. 

As mentioned in "Describing Context and Trends," defining vocational program 
completion presents a particular challenge at the secondary level. While some states 
provide guidelines for determining completion status such as attainment of specified 
competencies, others leave the determination of completion to the faculty, school, or 
district. Consequently, procedures for counting vocational program completers vary 
across and even within states. The most common method of conferring completion status 
is based on course completion — that is, achieving passing grades in all courses offered as 
a sequence of courses in a paxticular vocational program area. Frequently, a sequence is 
made up of two or more consecutive courses, in some cases involving some sort of work 
experience component. In some school districts, particularly in rural areas, the entire 
sequence of courses may consist of a single course. Consequently, completion status, 
particularly at the secondary level, represents a broad range of occupational and related 
academic learning. 

Most state MIS databases also contain information on enrollments in vocational 
education. However, these data are more troublesome than completion data for several 
reasons. As mentioned in the introductory chapter, students enroll in courses, not in 
programs. A particular course identified as being in one of the major two-digit CIP 
program areas may be part of two or more programs at the four- or six-digit level. Unlike 
program completion, which can be assigned after a student has completed a sequence of 
courses, enrollment cannot accurately be assigned to a program area below the two-digit 
level. However, many states collect and report enrollment data at the same level of detail 
as completion data. 
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Transcript data, which provides a longitudinal look at student coursetaking 
patterns over more than one year, permits assigning students to a program with a fair 
amount of accuracy. However, most states tally enrollment figures based on coursetaking 
in the current year only. Because students enroll in courses with varying goals and 
intentions, states 9 vocational enrollment figures are generally not valid indicators of 
"program" participation. Students may explore vocational education without any 
intention of completing a program. In fact, recent research indicates that almost all 
secondary school students and more than three-quarters of the students in public two-year 
postsecondary institutions take at least one course in the vocational education curriculum 
during their educational careers (Hoachlander et ah, 1992). Consequently, program 
enrollment figures can fluctuate from year to year, although local fluctuations may cancel 
out when data is aggregated at the state level. 

Many states attempt to deal with the problem of inferring program enrollment 
from course enrollment by dividing coursetaking into two levels: (1) exploratory, 
introductory, or nonoccupational courses and (2) occupational courses. Often states 
group consumer and homemaking education and industrial arts (i.e., technology 
education) courses and courses that introduce students to a cluster of occupations in the 
first category and reserve the second category for occupationally specific courses that are 
intended to lead to employment in a particular occupational field. However, the methods 
by which states assign courses to these categories vary widely. Furthermore, some states 
include students in grades nine through twelve in their count of vocational enrollments, 
while others include only those in grades ten through twelve or eleven and twelve. By 
including students in later grades only, states attempt to avoid counting nonoccupational 
courses. 

Other states go one step further, assigning codes to courses based on the degree of 
certainty to which the course indicates enrollment in a particular program. For example, 
exploratory courses may receive a code indicating a relatively low degree of certainty that 
the student is actually enrolled in the program area of the course, while a higher-level 
course requiring as a prerequisite completion of previous courses in the sequence may 
receive a code indicating a relatively high degree of certainty that the student is actually 
enrolled in a particular program area. However, the number of states attempting to sort 
out program enrollment from course enrollment by this level of refinement is small. 
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Because students enroll in courses rather than programs, procedures for assigning 
program enrollment based on coursetaking force states to report enrollments either as 
duplicated or unduplicated counts. Unduplicated enrollments assign a single program 
area to each student, and provide a count of the number of students enrolled in vocational 
programs. Duplicated enrollments count students more than once if they took courses in 
more than one program area and provide a count of the number of program enrollments, 
which may be greater than the number of students being trained. While states with 
automated student record systems have the flexibility to produce either unduplicated or 
duplicated counts, other states may only be able to produce duplicated counts. Some 
states request from schools and institutions the total number of students enrolled in each 
course or program area but not individual student information, so the aggregate data 
cannot be unduplicated. Still other states request unduplicated total enrollments and 
enrollments by gender but collect only duplicated counts for the special populations. 

Since students may fall into more than one special population category, aggregate 
enrollment information generally provides duplicated counts of the number of special 
populations enrolled in each program area. The sum of the number of handicapped, 
limited-English proficient, and economically disadvantaged students reported enrolled in 
a particular program area may be greater than the number of individuals who are 
members of special populations enrolled in that program area because students may 
belong to more than one of the targeted groups. In these cases, it may not be possible to 
produce an unduplicated count of the total number of special population students enrolled 
in vocational education in a state. 

The practice of collecting and reporting program enrollments, rather than course 
enrollments, originated from the old Vocational Education Data System (VEDS) 
requirements and is perpetuated in OVAE's annual performance reports. The primary 
purpose of counting enrollments in vocational education is to estimate the size of the 
enterprise. As stated previously, unduplicated program enrollments provide information 
on the number of students being served, while duplicated program enrollments provide 
information on the number of program enrollments. However, given the problems in 
inferring program enrollment from coursetaking, neither of these measures of program 
enrollment provides accurate information on the number of students being trained or on 
the amount of training being offered in a particular field. The count of program 
completers provides a better indication of the occupationally specific training being 
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delivered nationwide. Perhaps a better measure of the size of the vocational education 
enterprise in any given year is simple course enrollment. A count of course enrollments 
or contact hours provides an indication of the amount of vocational training be*ng 
delivered in various vocational fields and at various levels of coursetaking while avoiding 
some of the pitfalls of current program enrollment data. 

OVAE's MIS plans to collect information from the states on program completion 
and program enrollment, both at the four-digit CIP level. As discussed above, a count of 
program completers, particularly at the postsecondary level, provides generally reliable 
information on the amount of occupationally specific training being delivered nationwide 
and is a rough indicator of the recent supply of trained labor in a particular field. In 
contrast, program enrollment information is much less meaningful at the four-digit CIP 
level. Because of the difficulties of assigning program enrollment based on coursetaking, 
it is sufficient to report program enrollment at the two-digit CIP level. 

In addition to total enrollment and completion counts, OVAE intends to collect 
information for the various special populations and for programs other than the traditional 
occupational programs, including Tech Prep, cooperative work experience, 
apprenticeship, and work study. As mentioned above, the capacity of states to provide 
this type of information varies widely. The submission of data to OVAE is voluntary, so 
states will provide the data that is available. The MIS will accommodate the various state 
practices, for example, indicating whether a state's data is duplicated or unduplicated. 

At both the secondary and postsecondary levels, at least half of the states have 
implemented a measure of retention or completion in their performance measures and 
standards systems (Rahn et al M forthcoming). At the secondary level, about one-third of 
the states are measuring the percentage of vocational students who are retained in or 
complete a vocational program, and one-third are measuring the percentage of vocational 
completers who graduate from high school. A smaller number of states is measuring the 
decrease in number of dropouts. At the postsecondary level, about one-half of the states 
are measuring the percentage of vocational students who are retained in or complete a 
vocational program, and a small number is measuring the decrease in number of 
dropouts. 
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Most states that are measuring enrollment include access for special populations. 
About half of the states at both the secondary and postsecondary levels have implemented 
a measure of enrollment specifically for special populations. A handful of states is 
measuring the percentage of all students enrolled in vocational courses at either the 
secondary or postsecondary level, and one is implementing a measure of attendance at the 
postsecondary level. 

Accomplishments 

Some OIS contain information on the wages and benefits of specific occupations. 
This information is mostly obtained through surveys of employers, asking, for example, 
what the standard entry-level wages and benefits are for specific occupations. A few 
states are contemplating including actual rather than estimated information based on 
wage record data obtained through the State Employment Security Agency (SESA). 
Wage record data can provide the actual average earnings of recent program participants, 
rather than employers* stated pay levels and can be reported separately for various 
demographic groups and for various substate regions. Some SOICC staff believe this 
provides more relevant information for students anticipating entering the labor market 
and for prospective students considering in which program or institution to enroll. 

Many local and state vocational educators examine placement information as part 
of the program review process. Educators want to know whether program completers 
found employment, whether they found employment in a field related to their training, 
and whether different types of students had various labor market experiences. They also 
want to compare placement rates of the different programs to determine which programs 
have been more or less successful in placing students. A review of placement 
information often leads to developing strategies for improving the placement of students 
or of certain groups of students, to incrersing recruitment efforts for attracting students to 
programs with high placement rates, and sometimes to removing less successful 
programs. 

Procedures for collecting placement data vary widely across the states. Some 
states leave data collection to local schools and institutions, with some of these states 
collecting the resulting information at the state level, and others not doing so. Other 
states collect their own placement data in addition to and separately from local efforts, 
while still others collect the information on behalf of local providers, distributing the 
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relevant data to them. At the local level, data collection may be the responsibility of a 
central office, or individual program faculty may follow up on their own students. Most 
current data collection efforts rely on either phone or mail surveys of former program 
participants, with some states and locals surveying employers either in addition to or in 
lieu of participants. Some locals and states gather information on placement in further 
education and training as well as on entry into the labor market. Many follow-up surveys 
track the placement outcomes of program completers only, while others track program 
leavers as well as completers. 

The quality of placement data also varies widely. Surveys conducted by phone, 
and by mail in particular, are notorious for producing response rates sometimes as low as 
twenty-five to thirty percent. The main problem with low response rates is that they 
usually indicate nonresponse bias; that is, the former participants who respond may be 
different from those who do not respond in ways that are important to the survey. 
Frequently, the lowest response rates in a state come from school districts and 
postsecondary institutions in urban areas, suggesting that this placement data may be 
biased against special populations. Former participants who return a mailing asking 
questions about employment are more likely to be employed than those not returning the 
mailing. Administrators who base program decisions on this data may be drawing 
incorrect inferences from the responses received. 

In order to improve the quality of the data collected, as well as to decrease the 
costs of and duplication of effort involved in collecting placement data, some states are 
using or are contemplating using SESA wage record data. While this data has its own 
limitations as described in "Monitoring Program Compliance/* it generally provide a 
reliable and cost-effective means of gathering information on employment and earnings. 
When combined with other administrative databases such as federal civilian and military 
employment and two- and four-year postsecondary institution enrollment databases, wage 
record data can provide a powerful source of information on the placement of former 
vocational/technical students. 

OVAE's MIS plans to collect data from the states on the placement of former 
program participants in further education, the military, and related and unrelated 
employment. The data will be requested at the four-digit CIP level. As described above, 
the capacity of states to generate this information will vary. 
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By design, the performance measures and standards systems are outcome based 
and therefore include a number of measures of both learning and labor market outcomes. 
Virtually all the states have implemented a measure of academic gains since such a 
measure was required explicitly by law at each of the secondary and postsecondary 
levels. At each of the levels, about two-thirds of the states have implemented a measure 
of occupational skills attainment, and about one-third have implemented a measure of job 
or work skills attainment. A much smaller number of states are measuring occupational 
skills and job or work skills gains. In terms of labor market outcomes, most states at each 
of the secondary and postsecondary levels have implemented a placement measure, 
usually including placement in further education, the military, and related and unrelated 
employment. A small number of states have implemented measures of employer 
satisfaction and earnings. 

Personnel 

While most states maintain information on faculty in central personnel files, the 
amount and accessibility of information on vocational faculty varies by state. At the 
secondary level, most states can identify vocational teachers based on certification or 
credential information. At the postsecondary level, the distinction between vocational 
and nonvocational faculty is not always drawn, and data on faculty must be sorted by 
program affiliation, where available, in order to identify vocational faculty. In some 
states, the information available on faculty may be limited to basic demographics such as 
sex and race/ethnicity or educational and work history. However, some state agencies 
collect additional information on course or section assignments from school districts and 
postsecondary institutions, and some also collect information on faculty supply and 
demand. The advantage of general faculty databases is that they allow a comparison 
between faculty with and without vocational teaching responsibilities. 

In contrast, some state agencies responsible for vocational education collect and 
maintain separate information on vocational faculty. In some cases, these agencies 
collect information that may not be available through the general state agency, including 
primary teaching assignment, course responsibilities, and class sizes; and in other cases 
they may duplicate data collection ei forts. Some of these agencies also collect 
information on other staff with vocational education responsibilities. In these states, the 
amount of information available on vocational faculty may be enhanced, although the 
capacity to compare vocational and nonvocational faculty may be limited. 
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OVAE's MIS plans to collect data from the states on the current number of and 
future need for vocational faculty at the four-digit CIP level. As described above, states 
have varying capacities to provide this information. At the secondary level, most states 
can provide the total number of vocational faculty as well as the number certified in 
various program areas. Those states that collect course assignment information will be 
able to assign faculty to program areas using procedures similar to those discussed for 
assigning students to program enrollment areas. At the postsecondary level, institutions 
generally maintain data on faculty at the two-digit level for EPEDS, although those states 
that collect course assignment information could provide more detailed information. 
Some states will not be able to provide any data on the future need for faculty. 



Facilities and Equipment 

Most local vocational providers and states do not maintain comprehensive 
information on facilities and equipment used for vocational education. As discussed in 
"Monitoring Program Compliance," local providers do maintain information on the uses 
of Perkins funds, and most can provide a detailed accounting of the equipment purchased 
with these funds. However, an attempt to calculate the total amount of facilities and 
equipment devoted to vocational education would require estimating a prorated amount 
based on some known quantity of vocational education. For example, facility space 
could be assigned based on the proportion of contact hours that were associated with 
vocational courses. 
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Costs 

As mentioned in the "Describing Program Practices" and "Monitoring Program 
Compliance" sections, some school districts maintain separate budgets and expenditure 
records for vocational education, including information on salaries and supplies, and 
some postsecondary institutions do so for each department. This information is generally 
not kept at the state level. Furthermore, the information may not include capital 
expenditures, which often cannot be assigned strictly to vocational education. In order to 
estimate the overall costs of vocational education, capital expenditures would have to be 
prorated in a similar fashion to facilities and equipment. 
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Summary of Data Availability 



As mentioned earlier in this section, the primary purpose of performance 
monitoring systems is local and state program improvement. While this data may also 
provide national-level policymakers and program managers with useful information, the 
data is limited in several important ways: (1) it lacks comparability across and within 
states, (2) its quality is questionable in certain cases, and (3) it lacks consistency over 
time. Consequently, while contributing texture to what is known about the performance 
of programs at the local and state levels, this data should not be used to produce 
statistically rigorous national estimates. 

Lack of Comparability Across and Within States 

All of the systems described in this section, including OIS, MIS, and performance 
measures and standards systems, are subject to variations in state and even local 
practices. Variations can be found in the types of providers and programs included in the 
system, procedures for identifying and classifying special population students, definitions 
of program completion, procedures for counting program enrollments, capacity to provide 
duplicated and unduplicated counts, procedures for collecting placement data, the types 
of information available on vocational faculty and other vocational staff, and the number 
and types of performance measures and standards. Appendix B summarizes the findings 
from the site visits conducted for this study regarding the comparability of local and state 
MIS data collection. 

National databases, including OVAE's MIS, that attempt to compile data from 
these state systems must exercise caution when comparing data across states. In order to 
provide truly useful information that contributes to an understanding of the performance 
of vocational programs at the local and state levels, such databases must include a 
description of the varying state practices relevant to the data elements included in the 
system. While most states would welcome guidance and technical assistance from 
federal agencies in collecting and analyzing their data, this involvement must leave room 
for differences in state needs and in constraints regarding vocational education data. 

Data Quality 

In some cases, the quality of the data collected by states is questionable. First, as 
discussed previously, since students generally enroll in courses rather than programs, 
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enrollment cannot accurately be assigned to a vocational program area below the two- 
digit CIP level. Furthermore, the validity of the entire process of inferring program 
enrollment from coursetaking in a single year is questionable. Second, placement 
databased on low response rates to phone and mail surveys and other studies may be 
subject to significant nonresponse bias. Federal agencies can provide valuable assistance 
to the states by offering guidance on data collection and reporting strategies that produce 
high quality data on vocational education. 

In other cases, the quality of local data is unknown. State vocational education 
agencies are not always aware of local data collection and reporting practices and of the 
quality of the data submitted to them. While local data is generally considered to be more 
accurate and reliable when it is used to distribute state or federal funds or when they are 
relevant to local uses and needs, these judgments are more frequently based on 
speculation and anecdotal evidence than on systematic studies. More attention needs to 
be paid to local data quality if state MIS are to be relied upon to provide useful and 
accurate information. 

Lack of Consistency Over Time 

Even seemingly simple changes in data collection procedures can produce large 
variations in performance data. For example, course enrollment counts are very sensitive 
to the timing of data collection. Shifting the date for counting enrollments by even one or 
two weeks can cause a large increase or decrease in the numbers reported. Changes in 
data collection procedures occur for a variety of reasons, including both administrative 
and programmatic reasons, and they occur at both the local and state levels. Since 
vocational education is part of the larger education enterprise, changes in general data 
collection may affect vocational education data. State- and national-level databases must 
keep track of changing data collection procedures if variations in performance data over 
time are to be interpreted correctly. 

Performance Measures and Standards 

Although subject to many of the above comments, state performance measures 
and standards systems present additional challenges. Unlike state OIS and MIS, which 
have been in existence for some time, these accountability systems represent largely new 
endeavors at collecting and analyzing data for vocational education. Some states' 
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systems of performance measures and standards rely on data collection strategies that 
were in existence prior to the 1990 Perkins Act, and that were already part of state MIS. 
However, the 1990 accountability requirements compelled most states to re-examine their 
data collection efforts and many to develop wholly new strategies. Furthermore, while 
many states already collected some performance data, few had established vocational 
education standards. 

Because of the newness of these systems, there is an ongoing need for technical 
assistance that will help states evaluate and improve the systems implemented in fall 
1992. Specifically, the department could assist states with (1) further development of 
performance measures, (2) definition of standards, (3) student assessment, and (4) 
adjustments and incentives for serving special populations. 

Measures 

The law requires that states develop measures of learning and competency gains 
and explicitly states that these must include measures of student progress in the 
achievement of basic and more advanced academic skills. Implicit in this language is the 
requirement that states must also include measures of gains in occupational skills, 
although the law does not clearly say so. Nevertheless, given that one of the primary 
purposes of vocational education is preparing students for employment, measures of 
occupational competency are clearly a desirable component of the accountability system. 

As important as measures of occupational competency may be, most states have 
encountered serious difficulty in developing appropriate measures. Occupational 
competency testing is neither as widely developed nor as rigorously standardized as 
academic achievement testing. Moreover, there is not yet widespread consensus on what 
types of occupational competencies should be assessed, on what skills reflect an 
understanding of "all aspects of a given industry," or on how these skills should be tested. 
Consequently, the federal government could provide valuable help to localities and states 
through supporting the development of occupational assessment and by training 
educators in how to conduct more effective assessments of occupational knowledge and 
skills. 

A key word in the law's language is "gains," evidence that participation in 
vocational education leads to an increase in knowledge and skills. There are at least two 
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approaches to measuring gains. First, some form of pre- and posttesting can be used. 
This method is student-based and assesses changes for individual students in knowledge 
and skills over some specified period of time, for example, between fall and spring or 
between eighth grade and eleventh grade. Second, gains can be measured 
programmatically over time. Such an approach averages scores of students participating 
in a program at one point in time and compares this average with an average from an 
earlier period to determine whether scores have improved. While the first approach pre- 
and posttests the same students, this second approach typically tests different students. 
This latter approach requires statistical controls for changes in student characteristics and 
in other variables external to the program that may influence achievement. 

The measurement of gains is a topic that confuses many states. Technical 
assistance that helps states to clarify how to define and measure gains would greatly 
improve the accountability systems developed to date. 

In contrast to gains, one can also measure learning attainment, the actual level of 
competency (occupational or academic) that a student has mastered. Competency 
attainment and job or work skill attainment are two of the four options states have in 
developing their second set of required performance measures. This is another area in 
which states will continue to need help. 

Standards 

While all the states appear to have made substantial progress in identifying and 
defining performance measures, establishing standards for these measures has proven 
more difficult. Most states have used existing data (or will use baseline data from the 
first year of operation) to set standards. For example, a state might set a standard for 
academic achievement based on the statewide average test score for students participating 
in vocational education programs. Whether such a standard bears any relationship to 
requirements of the workplace or to further education opportunities is, for the most part, 
unknown. 

Ideally, standards should reflect valid requirements for performing effectively in 
the workplace or for succeeding in further education or training. The few states that have 
developed competency-based curricula and rigorous occupational competency testing and 
certification procedures have sought to validate competencies and standards through 
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employer involvement. Even in these states, however, there have been few true tests of 
the validity of these assessments. 

Nationally, the U.S. Department of Education and the U.S. Department of Labor 
are sponsoring a variety of projects charged with developing national industry standards 
in such fields as allied health, electronics, printing, and environmental technology. A few 
states have undertaken their own studies of industry standards. How fruitful these efforts 
will be remains to be seen. If they are successful, their findings will need to be 
incorporated into the state standards that are part of the accountability systems. How best 
to accomplish this incorporation is another topic for technical assistance. 

Student Assessment 

In many respects, these systems of measures and standards are only as good as the 
assessment instruments used to gauge students* competency gains and attainment. At the 
secondary level, most states administer statewide student achievement tests of reading 
and math. Typically, states are using these tests to assess gains and attainment in 
academic skills to satisfy the 1990 Perkins Act requirements. While this approach is a 
good first step, it leaves much to be desired. None of these tests has been designed to 
assess students' abilities to apply academic concepts in work settings. Few, if any, are 
competency-based; and most are not administered in grade twelve, making accurate 
measures of gains difficult. At the postsecondary level, widespread uniform testing of 
students' academic knowledge and skills is much less routine. Developing good 
measures of academic attainment and gains for postsecondary students has, therefore, 
been more problematic. 

At both the secondary and postsecondary levels, there is relatively little 
assessment of occupational knowledge or competencies. Widely accepted, validated tests 
of occupational competencies do not yet exist. Moreover, there is no strong consensus 
about what kinds of occupational competencies should be measured. Existing 
competency tests tend to focus on rather specific occupational skills rather than some of 
the more generic skills that have been promoted by recent national commissions and 
several researchers. 

There are several interesting efforts underway to develop better tests of 
occupational competencies and related academic skills. Some of these efforts are 
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concentrating on designing standardized, paper-and-pencil tests. Others are attempting to 
develop a more performance-based approach to assessment, experimenting with 
portfolios and other types of graded and ungraded performance testing that use 
simulations or actual performance demonstrations to measure student proficiency. 

At a minimum, locals and states will need information about what kinds of 
instruments have been developed, their advantages and disadvantages, and the kinds of 
educational settings for which they are best suited. The Department of Education could 
support a clearinghouse on assessment, as well as sponsor regional workshops on the use 
and interpretation of new assessment instruments. The federal government may find it 
desirable to support the development of particular assessment instruments such as tests of 
work readiness or computer-simulated assessment. 

Special Populations 

Section 115 of the 1990 Perkins Act requires that the accountability systems 
include "incentives and adjustments that are designed to encourage service to targeted 
groups or special populations." Federal law and regulations provide no guidance on what 
these incentives and adjustments should be or on how they should be incorporated into 
accountability systems. To date, most states have postponed making specific adjustments 
to their proposed measures and standards or introducing incentives. Satisfying this 
requirement can involve rather complex quantitative analysis and other kinds of technical 
expertise that is not routinely available in many states. Ensuring that this requirement is 
addressed fairly and effectively will probably require technical assistance to the states. 
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CONCLUSIONS 

Design of a. Multiform System 

As stated in the 1990 Perkins Act, a national vocational education data system 
should serve two primary functions by providing information relevant both to 
policymaking and to program management. In order to meet these needs, national data 
must address four subsidiary functions described in the second through fifth sections of 
this report: (1) describing context and trends, (2) describing program practices, (3) 
monitoring program compliance, and (4) monitoring program performance. Each of 
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these four functions serves different purposes and requires different data collection 
strategies. But the functions are not mutually exclusive, and data that serves one function 
may be useful in another. Data for all four functions may be used to establish federal 
policy and to manage programs. However, the four functions are sufficiently distinct that 
one must guard against the temptation to design a single system that will simultaneously 
meet the requirements of all four. The distinct requirements of these functions argue for a 
multiform system of vocational education data collection rather than a single, uniform 
design that will address all concerns. 

Data describing the context of vocational education and trends and changes over 
time allow policymakers and program managers to assess the general evolution of 
vocational education nationally. This data provides information necessary for program 
planning, setting priorities, targeting resources, and identifying areas requiring new 
direction and leadership. Data describing context and trends requires a high degree of 
uniformity and comparability over time, although it does not need to be collected 
frequently. This data should not be collected in isolation from other types of experience. 
Compared to universal censuses or elaborate experimental designs, national sample 
surveys are relatively low-cost, low-burden strategies for producing accurate national 
estimates of key context and trend variables. Responsibility for administering thess 
surveys has been lodged with federal agencies experienced in national statistics. 

Ongoing, national statistical surveys cannot, however, answer many important 
questions about vocational program practices. Surveys designed to provide consistent 
information on context and trends over time cannot assess the impact of many major 
policy initiatives. Understanding how states and local schools and institutions responded 
to the 1990 Perkins initiatives, for example, requires studies specially tailored to 
assessing these responses. Such studies typically are not the responsibility of the 
statistical agencies but of agencies charged with evaluation, implementation, and 
research. Special studies endeavor to describe vocational program practices thoroughly at 
a particular point in time and to capture variations in local and state approaches. They are 
less well-suited to assessing the long-term impact of policy on student outcomes. For 
instance, policymakers cannot expect the current National Assessment of Vocational 
Education (NAVE) to detect changes in student outcomes resulting from the 1990 
Perkins initiatives. The national statistical surveys, as well as additional special studies 
and research, will be able to contribute to assessing these longer-term impacts. 
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The agencies overseeing the implementation and administration of federal policy 
for vocational education are responsible for monitoring whether states and local 
recipients of federal funds are in compliance with various federal requirements. 
Monitoring compliance requires that information supporting this function be maintained 
(although not necessarily reported) by all those who are accountable. While the actual 
collection of data to assess compliance may rely on sampling techniques, data must be 
maintained by the universe of recipients of federal funds. Since collecting and 
maintaining universal data can be extraordinarily costly and burdensome, extreme care 
must be taken in defining the parameters of data needed for this function as well as the 
extent to which locals and states will be required to report information rather than simply 
maintain it. 

Finally, educators and policymakers at all levels are concerned with what 
vocational education accomplishes, including both learning and labor market outcomes. 
To assess program performance, local and state educational agencies and institutions have 
developed and continue to refine a variety of data systems designed to yield information 
on how well vocational education is performing. The primary purpose of these 
performance monitoring systems is local and state program improvement. As such, these 
data systems reflect the diversity of local and state needs and circumstances and are not 
well-suited to providing uniform national data on program performance. Because 
definitions and methods of collection vary, local and state systems cannot yield 
information that can be aggregated across states to produce national estimates on the 
performance of vocational education. Efforts to impose greater comparability :.md 
uniformity on these systems risk undermining their primary purpose. While national 
estimates of program performance are certainly desirable, these will best come from other 
sources such as national statistical surveys and special studies. 

Design of a national vocational education data system needs to keep these various 
functions in mind. Each contributes something different to what is known about the 
enterprise and is subject to different limitations. 
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Setting Priorities for National Data Collection 



Considered together, the four functions of vocational education data produce a 
wealth of information on the vocational education enterprise, yet none is sufficient in 
itself to address all policymaking and program management concerns. Even as a whole, 
the existing multiform system does not provide all the information that is desired on 
vocational education. The "Describing Context and Trends/* "Describing Program *. 
Practices," "Monitoring Program Compliance,'* and "Monitoring Program Performance'* 
sections described the data that is available through each function. The chart on the 
following pages summarizes briefly the sources of available information for the seven 
primary areas of policy and management concern. In some cases, relatively simple 
modifications are needed to improve the availability of information; while in others, 
improvements may require substantial effort. 

The process of setting priorities for modifying existing data collection efforts and 
collecting new data should be based on two criteria: (1) importance of the data for 
policymaking and program management and (2) cost. This section of the report 
establishes priorities based on the importance of the data and discusses broad cost 
concerns. However, evaluating the precise cost of the many possible data improvement 
strategies goes beyond the scope of this study and is better left to the responsible federal 
agencies. 

Based on their importance for policymaking and program management, the 
priorities for national vocational education data collection include information on the 
following broad categories: 

• Organization and governance 

• Student participation 

• Program offerings 

• Accomplishments 

• Faculty 

Information on the oversight of vocational education and the structure of the delivery 
system in each state facilitates national data collection efforts as well as communication 
among the local, state, and federal levels. Specifically, information on governance and 
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organization contributes to an understanding of how federal policy is implemented at the 
local and state levels and enables vocational education administrators at all levels to assist 
in improving programs. Data on student participation and program offerings answers 
questions about the scope of the vocational education enterprise. Who participates in 
vocational education? What programs are offered? How much vocational education do 
students take? Data on accomplishments, including learning and labor market outcomes, 
provides information on how well vocational education is meeting the needs of students 
and, more broadly, of business and industry. Data on faculty, including information on 
instructional strategies, describes perhaps the most important resource in the vocational 
education system. 

These categories of information should be given the highest priority in a national 
data system because they act as important indicators of the effectiveness of federal policy 
and of the need to improve programs. Data on accomplishments provides the most direct 
indication of the effectiveness of policies and programs, offering evidence of the amount 
and types of student learning and of students' subsequent employment, education, and 
training experiences. While not describing outcomes per se, data on student participation 
and program offerings provides information on access to and progress in vocational 
education for various groups of students, and data on faculty can potentially be linked 
closely with student outcomes and program performance. Information on the governance 
and organization of vocational education describes the context in which all of these forces 
work. 

Of lesser priority for a national vocational education data system is information 
on the following categories: 

• Administrators 

• Facilities and equipment 

• Costs 

While data on each of these subjects contributes additional and interesting information on 
the vocational education system, it is less important as an indicator of the effectiveness of 
policies and programs. In contrast to the priority areas listed above, data on 
administrators, facilities and equipment, and the costs of vocational education provides 
information primarily on inputs into the system, rather than on the system's outcomes. 
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Where data on student accomplishments or participation, for instance, indicate a problem 
or a success in the system, further investigation may lead to one or more inputs as the 
underlying cause. However, given limited resources at the federal level, a national 
vocational education data system should focus on collecting information that indicates the 
health of the system rather than on the myriad factors contributing to failures and 
successes. 

The above discussion provides broad guidelines for setting priorities for 
modifying existing data collection efforts and collecting new data. "Describing Context 
and Trends/* "Describing Program Practices," "Monitoring Program Compliance," and 
"Monitoring Program Performance" described in detail the problems that can be 
addressed and the gaps that can be filled to improve available data in the five priority 
areas. While the responsible federal agencies must decide upon the specific strategies to 
pursue, they should pay particular attention to two recurrent themes emerging from this 
study. 

First, the existing multiform system is severely limited in its ability to provide 
information on the vocationally relevant learning outcomes of students, specifically on 
their occupational competencies, applied academic skills, work readiness skills, and 
understanding of all aspects of the industries they are preparing to enter. The national 
statistical surveys, special studies, and systems of performance measures and standards 
are all impeded in collecting and reporting this information because of the lack of 
appropriate assessment instruments and, more fundamentally, because of the lack of 
consensus on what types of skills should be assessed. 

Second, a recurring problem across all types of data collection is incomplete 
coverage of the vocational education enterprise. The national statistical surveys and 
special studies vary in their ability to provide information on vocational programs offered 
through the various types of school and institutional arrangements. The surveys also do 
not always capture the full range of experience of students participating in vocational 
education (including the various reasons why students participate and whether they 
achieve their personal goals) or the full range of vocational programming. Data collected 
for compliance and program monitoring purposes varies in its capacity to describe 
nonfederally funded programs in addition to federally funded ones. While it would be 
inefficient for all data collection activities to attempt to answer all questions and while 
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some vocational education pursuits may be too uncommon to warrant federal funds, there 
is certainly room for improving the coverage of such a diverse enterprise. 



Table 1 
Summary of Data Sources 





Describing 
Context and Trends 


Describing 
Program Practices 


Monitoring 
Compliance 


Monitoring 
Program Performance 


Organization and 
Governance 


Secondary level - CCD 

Fostsecondary level - 
IPEDS, NSOPF, 
NPSAS, NHES, CPS 


OPBE- study of 
vocational education 
systems and facilities 

NCR VE - studies of 
education and training 
for work and strategies 
for linking planning and 
evaluation 


OVAE - state plans 


OIS- State Training 
Inventories 

MIS - state systems 


Student Participation 


Women, Indians, 
Minorities - HS&B, 
NAEP, NELS:88, NLS- 
72, IPEDS, CPS, 
NPSAS 

Individuals with 
Handicaps -HS&B, 
NAEP,NELS:88, NLS- 
72, NPSAS, NLTS 

Individuals of Limited 
English Proficiency - 
NELS:88, NAEP 

Economically 
Disadvantaged Students 
-HS&B,NELS:88, 
NAEP, NLS-72, NPSAS 

Single Parents - HS&B, 
NAEP, NELS:88, NLS- 
72, NPSAS, CPS 

Incarcerated Youths and 
Adults - NALS, Surveys 
by Bureau of Justice 
Statistics, Federal 
Bureau of Prisons, 
Office of Juvenile 
Justice and Delinquency 
Prevention 


NAVE - omnibus 
surveys, case studies, 
study of funding 
distribution, correctional 
surveys, and analysis of 
HS&B, NAEP, 
NELS:88,SASS 
(secondary level); 
NPSAS, BPS 
(postsecondary level) 


OVAE - state plans 

State Vocational 
Education Boards - local 
applications 

OCR -civil rights 
compliance programs 
and survey 


MIS -OVAE and state 
systems 

Performance measures 
and standards systems 



109 



114 



Summary of Data Sources (cont) 





Describing 
Context and Trends 


Describing 
Program Practices 


Monitoring 
Compliance 


Monitoring 
Program Performance 


Program Offerings 


Secondary level - 
HS&B, NAEP, 
NELS:88,NLTS 

Postsecondary level - 
IPEDS, CPS, NPSAS, 
BPS 


NAVE -omnibus 
surveys, case studies, 
survey of vocational 
student organizations 

OVAE - performance 
measures and standards 
study 

NCRVE - surveys of 
performance measures 
and standards 
implementation and 
study of their effects 

PES — tech-nren 
evaluation 


OVAE -state plans 

State Vocational 
Education Boards - local 
applications 

OCR -civil rights 
compliance survey 


OIS systems 

MIS -OVAE and state 
systems 

Performance measures 
and standards systems 


Accomplishments 


Secondary level - 
HS&B, NAEP, NELS:88 

Postsecondary level - 
NLS-72, HS&B, BPS, 
SIPP 


NAVE - analysis of 
NAEP, NELS:88, NLTS, 
SIPP; study linking 
unemployment insurance 
and student data; 
employer survey 


SESAs - wage record 
information 


OIS systems 

MIS -OVAE and state 
systems 

Performance measures 
and standards systems 


Personnel 


Secondary level - S ASS 

Postsecondary level - 
NSOPF 


NAVE - omnibus 
surveys, case studies, 
analysis of SASS, FRSS, 
NSOPF 


OVAE -state plans 

State Vocational 
Education Boards - local 
applications 

OCR -civil rights 
compliance programs 
and survey 


MIS - OVAE and state 
systems 


Facilities and 
Equipment 




OPBE- study of 
vocational education 
systems and facilities 


State Vocational 
Education Boards - local 
applications 

Local recipients - 
accounting of equipment 
purchased with Perkins 
funds 




Costs of Vocational 
Education 




OPBE -study of 
vocational education 
systems and facilities 

NCRVE -study of 
education and training 
for work 

NAVE - omnibus 
surveys, case studies, 
study of funding 
distribution 


OVAE - distribution of 
Perkins funds to states 

State Vocational 
Education Boards - 
distribution of Perkins 
funds to local recipients 

Local recipients - 
expenditures of Perkins 
funds 


Local providers - 
vocational education 
budgets, estimates based 
on prorating procedures 
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Given limited resources, federal agencies cannot be expected to remedy all of the 
problems identified in this study. Keeping in mind the priorities outlined above, the 
responsible agencies will need to weigh the relative cost of the many improvements that 
can be made against the value of the information those improvements will produce. The 
National Center for Education Statistics (NCES), for example, must decide whether it is a 
better use of funds to correct the undercount of area vocational schools in the Common 
Core of Data (CCD) or of proprietary institutions in the Integrated Postsecondary 
Education Data System (IPEDS); to expand the National Survey of Postsecondary 
Faculty (NSOPF) to include proprietary institutions and vocational/technical institutes; to 
increase the sample size of Asians and Native Americans included in the National 
Assessment of Educational Progress (NAEP) or longitudinal surveys; to enrich the 
Beginning Postsecondary Students (BPS) survey by developing a related institutional 
survey examining the relationship between teacher qualifications, experience, 
instructional strategies, and student outcomes; or to undertake another of the number of 
modifications that could be made. 

Generally, high payoff strategies for improving vocational education data involve: 
(1) increasing coordination among and within federal agencies, particularly with regard to 
the content and timing of various data collection activities and the definitions and 
measuring procedures used by the various agencies and (2) providing technical assistance 
to local and state vocational education providers, particularly with regard to the 
compliance and program monitoring functions, in order to improve the quality of the data 
they collect and report. Beyond these two strategies, the options available to the various 
agencies are many. Some represent relatively inexpensive adjustments to existing data 
collection, while others are more costly. 

Among the more costly improvements to the existing system would be collecting 
comprehensive information on the condition of facilities and equipment and the costs of 
vocational education. The former involves collecting new information on numerous and 
ever-changing techniques specific to a large number of vocational programs, possibly 
requiring independent on-site verification rather than self-reporting. The latter involves 
piecing together vocational expenditures information from local, state, and federal 
sources and applying some sort of estimating procedure where the information is not 
available. Since these two categories of information are also less important for providing 
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information for policymaking and program management, they should fall near the bottom 
of a final priority list. 



At times, however, the importance and cost of a specific improvement may point 
to different conclusions. For example, while efforts to improve information on student 
outcomes in the areas of occupational competencies, applied academics, work readiness, 
and all aspects of the industry are at the top of the priority list in terms of their 
importance for policymaking and program management, developing appropriate 
assessment instruments will require substantial resources and could prove quite costly. 
Therefore, the relevant federal agencies will need to determine the most appropriate role 
they should play in this process. 

The decisions that federal agencies will need to make are difficult and complex. 
This report identifies problem areas, suggests strategies for addressing those problems, 
and lays out broad guidelines for establishing priorities; but the responsible agencies will 
need to make the final decisions about what actions to take. 



Conclusions 

The existing multiform system already provides substantial information on 
vocational education. Improving national vocational education data requires 
strengthening this system, rather than restructuring or dismantling it. The following is a 
list of the final conclusions from this study that should guide future efforts to improve 
national data collection for vocational education: 

• It is important to maintain the distinction among the four functions of national 
data described in the "Describing Context and Trends," "Describing Program 
Practices," "Monitoring Program Compliance," and "Monitoring Program 
Performance" sections of this report and to recognize that a uniform system 
cannot meet all national data needs. 

• It is important not to try to meet multiple objectives with a single data collection 
strategy. For example, data collected for local program improvement purposes 
cannot be used to produce national statistical estimates, and special studies 
designed to assess local and state responses to the Perkins legislation cannot be 
expected to produce information on the long-term impact of policy initiatives on 
students. 

• Careful attention should be paid to deciding when new data collection should be 
institutionalized or when special one-time studies of vocational education are 
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more appropriate. Similar attention should be paid to the extent to which local 
and state providers are required to report, not just maintain, information on 
vocational education. Data should be collected in the broader context of general 
education where possible. 

With the exception of some compliance information, data on vocational education 
does not need to be collected at the national level more frequently than once every 
four or five years. 

The federal agencies responsible for collecting data on vocational education 
should establish a formal system for reviewing the vocational content of national 
surveys and studies. Furthermore, some sort of ongoing structure needs to be 
developed for addressing issues related to agency collaboration, timing, 
definitions, and common measuring procedures. The Department of Education 
may want to consider establishing a permanent advisory group similar to the 
Professional Working Group assembled for this study. 

Efforts to refine the existing vocational education data system should be 
integrated with other national data-related activities such as the movements to 
develop teacher certification and business and industry standards. 

Efforts should be made to communicate to the broader education community the 
types of information on vocational education that are available at the national 
level and the sources and locations of that data. 



Producing good national data on vocational education is an ongoing challenge. 
The history of congressional mandates to collect this data has been a series of attempts 
that assume that uniformity can be obtained from an enterprise that is extraordinarily 
diverse. In responding to the mandate of the 1990 Perkins Act, what is needed is not a 
new independent, centralized vocational education data system. Much more desirable are 
efforts to strengthen the existing multiform system. Information on vocational education 
can be improved largely by concentrating on fine-tuning existing and planned data 
collection with attention to improving timing, eliminating inconsistencies, and taking 
advantage of low-cost opportunities to collect additional data. Also needed is an ongoing 
process for identifying gaps in information and for deciding who is in the best position to 
fill them. Finally, while data collection should remain decentralized, it is desirable to 
increase the level of coordination within and among the responsible federal agencies. 
This report offers general guidelines and strategies for piecing together a more 
comprehensive picture of vocational education at the national level. 
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Table A I 

Overview of DalaseU Containing Vocational Education Data 
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Table A 2 



Quality and Type of Information on SEC. 421 (cHD Areas of Data Sets 



Database 


Teachers 


Administrators 


Students 


Facilities 
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IIS&U *2 Seniors 
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Senior cohort 
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Table A3 



Variables Useable for Identifying SEC. 421 (c)(1) Population Characteristics 



Datasets IA 
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Table A3— Continued 
Variables Useable for Identifying SEC. 421 (c)(1) Population Characteristics 
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I1S&B 82 
Secondary 
Transcripts 


— 




Gender differences in 

this cohort: percentage 

taking courses, credits in 

courses, by programs 
. . . * 1 . p 


Race ethnicity differences in 
this cohort: percentage 
taking courses, credits in 
couises. by programs 


Linked to IIS&B-8. 


HS&B-80 

Seniors 

Survey 


Marital status 
Dependents 


-- 


Gender differences in 
occupations 
bui just this cohoit 
to 1986 


Race-ethnicity differences 
in occupations 
hut just this cohoit 
to 1986 


Marital status hi; 
public assistance, w 
dependents to 1 


1IS&B-8Q 
Post sec 
Transcripts 
1980-84 


Linked to IIS&B-80 Survey 




Gender differences in 
this cohort: percentage 
taking courses, credits in 
courses, by programs 


Race ethnicity differences in 
this cohort: percentage 
taking courses, credits in 
couises, by programs 


Linked to HS&H 8( 


NLS-72 
Survey 


Marital status 
Dependents 




Gender differences 
in occupations, voc cd 
ticlds, but just (his 
cohort to 1986. 


Race -ethnicity differences 
in occupations, voc ed fields 
but just this cohort 
to 1986 


Marital status hi 
public assistance, * 
dependents to 1 


NLS-72 
PSE 

Transcripts 
1972-79 


Linked to NLS-72 Survey 




Gender differences in 
this cohort: percentage 
taking courses, credits in 
courses, by programs 


Race-ethnicity differences in 
this cohort: percentage 
taking couises, credits in 
couises, by programs 


Linked to NLS 72 



— Data not available in this datasct 



Table A3— Continued 



Variables Useable for Identifying SEC. 421 (c)(1) Population Characteristics 



Datasets 2A 


Women 


Native Americans 


Handicapped 


I.KP 


Eco. Disadvantaged 


SASS 
(faculty) 


Gender JTSC3I9] 


Race [TSC320] 
American Indian. 
Aleut, Eskimo 








NSOPF 
(faculty) 


Gender |F4I| 


Race|F44| 
American Indian, 
Aleut, Eskimo 






. 


IPEDS 
Fall 

Enrollment 


Women 


American Indian or 
Alaskan Native 








IPEDS 
Decree 

Completions 


Women 


American Indian or 
Alaskan Native 








IPEDS 
Fall Enroll 
Ocospcc 


Women 


American Indian or 
Alaskan Native 






- 


CPS 


Gender JI8GI] 


Race(l8J| 
Native American 








NELS-88 


Gender (SEX] 


Race (RACE) 
Native American 


In past progrm (HANDPAST 
1 Current handicap, program: 
1 Parent report (BYHANDPR) 
Teacher report (BYHANDTR 


Language in home 
JBYHMLANG) 
Is LEP (BYLEP) 
Is lang minority |BYLM| 


SES composite (BYSES) 
SES by quartiles (BYSESQ) 
G8URB AN Urbanicity 
U rban/s ubwbun/i ural 


NPSAS 


Gender 
1987 (SEX) 
1990 (GENDER) 


Racc|RACE| 
Native American 


Disabled 
1987: (S82) 
I990:|DISABLTY) 




family background. Patent's 
education, occupation 
See SES in Table All 



— Data not available in this daiatel 
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Table A3— Continued 



Variables Useable for Identifying SEC. 421 (c)(1) Population Characteristics 



Datasets 2B 


Slnelc Parents Incarcerated Gender Equity Programs Minorities Displaced lion 


SASS 
(faculty) 


Marital status (TSC323) 

Children (TSC324) 
Children ages (TSC325] 




Gender |TSC3I9| 
of vocational teachers 


Race 1TSC320| 
of vocational teachers 


Partial defir 
Marital status ( 
Children (IS 
Children ages f 


NSOPF 
(faculty) 






Gender |F4 1| 
by rank|F!2] 
by Held [FI6aJ 
by full/part-time [F4| 


RacelF44| 
by rank (FI2) 
by field |Pl6aJ 
by full/part-time (F4J 




IPEDS 
Fall 

Enrollment 






Gender percentages 
by level, not field 


Percentage nonwhite 
by level, not field 




IPEDS 
Degree 
Completions 






Gender percentages 
by degrees by prog 


Percentage nonwhite 
by degrees by prog 




IPEDS 
Fall Enroll 

Occ-spcc 






Gender percentages 
by prog 


Percentage nonwhite 
by prog 




CPS 


Marital status {Q9IAJ 
Haschildrcn|QI4B] 








Partial defin 
Marital status 
Has childrcnl 


NELS48 


Marital status 
Has children 
(later surveys) 




Percent gender by level and 
type of vocational courses 
(in transcripts in 2nd FU| 


Percent race-elh by level and 
type of vocational courses 
(in tianscrtpts in 2nd FU| 


(cohort too ) 


NPSAS 


Marital status (MARITAL) 
Number of dependents (S79| 




Gender percentages 
by major 


Percentage minorities 
by major 


Paitial defir 
Marital status \W 
Number of depen 



— Data not available in this datasct 



t able A4 

Secondary-Level Vocational Education Variables: Program Participation 




Concept* and Indicator* 

Student Dtmographics 
(lender 

Race-Fthntclty 

f.rade lx»el 



Handicap Stilus 



SKS 

III (It School Grade* 

Student Graduation Status 

School and Community 
School Type 



School Enrollment 



llrhanlclly 



iVrivcd gender |SEX| 

Derived race |DRVDRACE| 

Grade in 19*5-19*6, GRADE) 
Mostly Nth graders, nwge 7ih 12th 

Handicapped nr not If KTLAGI 
llandkapping condition |IICTYPE| 



Avg of student grades |STDGRAD|. 
wid by Carnegie units |CRSECARN| 

Student eail status IEXSTAT, 
Diploma celt, enrcilled. dn^xwn 



School type |STYPEl 
(public, private. Catholic. Bl A) 



Number of students in l<I*5 IHNROI.I I 



|t!RBAN] Urban (big city) 
suburban (urban fringe, medium city) 
rural (itnall place) 



Student file derived gender |I)SHX| 

Student file derived race |DRACEJ 

19*6 grades 3/7/1 1 
1990 grades 4/*/t2 

Only in deluded student file 



SES Composite: Muther. fiHher eductn 
|fiOtl334H A. BOOVdH A|: Reading 
materials in burnt |B«*W0I A 5A| 



Student file ISCIITYPE1 
School file ISSCIITYPI 



Student file INS1UDA] 
Scn»<iinie|SN<;niDA] 



Student file urbanicity |IIRBAN1 
Sih««il file peicent urban |rniRtlAN| 



Crfmkr isr.xi 

RaceethnkitylRACEJ 
I9*0sor^>mi*e*every2 yrsuptn 



II SAB compmite variable 
ItlANDJCAri based on reports of 
handicap or participation In 
handkappiogowns 

llSABeooa>isite vnruble ISESQI 
in quat tiles 



From OPA on uan<cript study or self 
repotl if no ttanscript IIISGRADESI 

High school completion |SYI2| 
(graduated, in hi m>w, no dipl. GEO) 



School type lllSTYPfc=p«btic| 
(public, private. Catholic) 



School total enrollment 
(SRIKI2A1 



llrbankitylSCIIURBAN) 
urban, suburban, rural 



Composite Gender |SE> 

Composite Race |R AC! 
Hispanic sabf roups If 112 
Aslaaffacific race comport* 
19** *th graders every two y 
Grade 12 and Beyond 

In put handicap prngtam (MAI 
farent report of carreat hand 
teaming dis program |B YtIA 
Teachei report |BY II AW 

S« Composite IBYSf 
SES hy tptattitet IBYSE 



In 2ndfo»nwup(l99: 



In 2ndfollowwp(l992)an 

foltnwiips 
Below: Grade t school Infc 
foBowvps: Grades 10. 12 sr. 
School control composite [C\ 
(puMiciCaiholicAprlv^priv. f 



School (trial enrollment co 

(BYSENRL, 
gth grade enrollment |G*f 

Ucbankity composite. |G*l 
urban, suburbaa. rw 



urinates data nut available in thu da* .net 



13.: 
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Table A4 — Continued 
Secondary-Level Vocational Education Variables: Program Participation 





Concepts a rut l*4llcatars 

Taking Courses 
S(«dka4 fartkipailwi 


l9a7Traai/S»rvcyi Not tinted. 

1H7 NAEPTrwcriptSlady 

PfltCnl lAlllg t«R.JUtNMl ItHMXk 

MmtJ below 


1990 Trani/Survcyt Will Be Linked 
|9gg ggrj IgO NAEP Surveys 

I'cuCiil tAm* »i» JtltMul miiiiCi 

Kmc J below 


Transcripts sikI 
I9S2 HSftl Sot* Transcripts 

I'cKCtit uking v««.44>«iitJ LtHiihCi 
listed below 


Siirw**Vv 1 in Ltd 

IM4-44 IIS A B Soph Sorveyl 
listed below 


NELSI8 
till trade Vase-Year (1 

Pen till ijkun; vicdllim J it* 
ttMRftpU below 

1 _ 1_ J r lln n d-k<rtJ A 4 ITU 

Sacvey: Peicentof 12ih fr* 
vmaiiunal prograim v» |d 
jL*k«ik, special c4 . uacf p 




Course Detail 


Oruitc4 cow** |CWSECSSC| 




Secondary scNhd intonomy 
tjkimg voc cowsc* M CTllACMil 


Tonk ■ morse w various occ prep wtu 
|r Y6AFY6QI 


l« 7n«l (i4litwup UonM-tipM 




Program Type 


tli< tctundarv w.h**4 tiAonuiny 

to group CRSECS5C. 
At*Jct«ic. w*.*«K»*i. priiun.il 


Grade 12 i« 1990 number term to* 
bruud tubjacu, inc Win* vol od 
|Bcll7llKrA| 


Secundjry schad uionomy: 
VtOtltWal tOOTSCS 1CTI1A, CIHB. 

cnici 


In 1 u( 7 vt«.au»>nJ D«»|r4n»j |I1W| 

A mj .if iiiifif Mak tea •ri.t/l lt^- Ix Ml 
AIM i a) LlHHaCWfWa> Wi |lrWC* ■la^iai w«. 

Uu»Mc»i.fc4eft|FYOL 
TuJe.MtJuiUy II-Y4II. IaK|I Y4K| 
(Hlier uwn»|rY4t | 


In 2nd Mltiwup lianKiipu 


A-8 


Voc Program Categoric* 


Um KionvUry Khtxi uauooiuy 

to griMpCt SGCSSC: 
Cttfuvw*. gaaceal. apocrfic SLMP 
DrcukJ pfOgf jiin M 1 SI MP 




S«.und*y Khuol iaioo«»ri»y: 
Cwwmet ,C1UA| Oeacral (CTllBI 
Specific Ubor market prep |CT1IC| 

Tea SI MP programs: 
irillCI.2. J.4, 3. 41. 62. 43 ,64 1\ 

s-v^u^^vm ir*nmi.7iAi 

rwkl ItMN *ei |C I nv.| i *fin| 
SrA.^Miwtc>:|CTlK:cl.7)B| 
Specially courses. 1CT1IC(I -1>C| 




U 2iul ttilliiwup u jnmtpti 




Carnegie Vniis Earned 
taunt Detail 


Dcuikd coucki |CHSECSSC| 
Carnegie aalu of eoone f CftSGCARN I 




Secondary school laaumjmy: 
If lakiag voccumtkj. average ckiIhi: 
If (CT1IA OOJ, average of |CT1IA-C| 




In 2nd fultowup UMtuipfe 




Prairam Type 


Uu tcuiodary kIhhJ i-uooomr 
w imp Cms ECS SC avg CP.SECARN 
Acadenic. tocaUtmal. penooal 


G**k 13 m 19911 number Kmc luuk 
brand tufcjncu. i*Ll»d*e* voe ed 
|B(107I06A| 


Secondary kImioI taJoaimiy: 
V,».<»i**al courses: ICT1IA. CTI1U. 

cntci 


In 1 ut 7 v««.4riofMt prufianu |FY2| 
Ajm «4 ciMfkCWivk m gradct 10-12 *■ 

" ■-: * .L»«ICVJll 

IratklaauiuyimiLialiimKI. 
(hk( vim. cieinrn |FY4( | 


1« 2nd tnHimnp ttanKripit 


t 


Vac Prafrara Categories 


Um secondary Khuut tuoaomy to 
gaaap CftSECSSC avg CP SEC A KM 
Cmmmt. general. ip*.Uk SLMP 
Dciaikd programi *■ • SI MP 




Secondly school luoaorny: 
Cmmmt |C1 IIA) General (CT1IB | 
SpeciTic Ubi* msAet prep |CT1IC| 

tea SI MP puff ami: 
iCillCI.2.1. 4.5. 41.62.43. 64 7| 
r/Hk4 courses |CTlrCl|.7)A| 
Second coooei: |CTIIC< 1-7* | 
SpeciakyciMrscs. |C?IIC<1-f|C| 




la 2nd Mtuwitp irannnpn 



— bdjeatta rUu am available m ihii dMaset 
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Table AS 



Secondary 



-Uvel Vocational Education Variables: Student Outcomes (Linked to Vocational Education Enrollment or Course 1 



C— c*»tt and Indicator* 

PSE Attendance 
Its Graduation Stains 

TypcofPSE InalkMllon 



Labor Market Partkipalioi 

Lctcl of Employment 
(P art He.*, FaB-Tlme) 



Uourly Wages 



By Urel of Employment 



IM7 TraaUSarvcvs Not Uafcad: 1990 Traai/Swvevs Will Be Liofced 



I9t7 NAEP Tra— crtl Slndy 



SwdcHUM tuiuft |EXSTaT| 
DipkMM. can. «Mi)0e4. *upoM 



Ijjj wm4 199$ NAEP S»nrtyt 



Trrflf^r** and Surveys linked 

iHIHSMSopfcTranacrtn* I im^llS*BSop»Siir>«j« 



•Soaw* MP* EmotlmeM and Employment Spell* Files and/or Second and Third Follow-up Survey File 



lltfh ictiwd giadtialo |KtiSNI EIT m 
Transcript hlel: |SY 12 U 2*IFU| 

PSE iflMiiuiiof" "Cental by 1914. I9U6 
•Sell report: il carolled M **y P*E 

bet*. 1912 and I VI 4 or 19*6. wbai 
typed): pub/piiv A U 2yr. 2yr. or 4yr 



Sit fiMNittu «tier la (cmIuvIkm: 
•Self-repuit: EatoHeU in PSE at thai mm 
•Self -ftpon: Employ men* M thai lime 
•Status: wwtiipfoyed. PT <<JS ntwrs). 
IT< 35 iMHtri of more), not U Umm f»«ce 



Sit month* alter N iraduaiioa: 
•Self-report Enrolled ia PSE at that time 
•Self -report: Ernphiyme* m dot time 

Average hiurly salary by FT. PT 
SOURCE: Mr* ErtqAiryntM Spdh lik 
and EnrUltncat SpclU Tile aadAtf 
iMlFllsorvey fde 



NELStg 



lih trade Bn*t-Vcar(l 



In 2nd and later follow 



In 3rd and later follow 



In 2nd and Inter follow 
In 2nd antUater follow 



In 2nd and later folloi 
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Tabic A6 

Secondary-Level Vocational Education Variables: Special Populations 



Concepts tnd Indicators 



Gendtr 
Women 



tmct-Etknkky 
Slack 



Native American 
Asian AmcrkM 

WkMe 

Otker 

lUmJuupptd 
llandkapsted 
Handicap Condition 

Et»n*mic*lty IHtttdratUagcd 



la Special Prof rami 
Academic AbltMy 



High School Grades 

Heme Language 
EagHsfc 
LKP/Oikcr Ik** EngHsk 



SJftg t* f*irenl» 

AdulU Netd Uttrminint 
DiipUced llomcmaktn 
St* E^uUy 



Incmrctruted 



l9t7Tra«^ufvey>NuiLwtc<l; i990Tiaa^»fvcTt Will Be I inked 



\m NAEf Transcript Study 



|kil*ed gemki |S»I:X| 



Demcd racclDKVORACEI 
Blatk. aua-Hi ip aai r 

llispjaic 
Naive Aokikjn 
Aw* Anniican/Paciftc blander 
WluK. MM- Hi iconic 
OUVi 



ItjnJKJppcJ iK am I1ICI1.AG) 
jland^cappiag tunUm.* |HCTYPE| 



Avg o< itwdcnt grade* ISTDCR AD| 
wid by Caracgia uaiu ICRSECARN 1 



Eitmuud gender balance in ct4>un 
Percent gcwfcr |SEX ) of tone taking 
at kul om fWM. second, or tpavialiiaJ 

C44MKk |CRSECSSi"| in rack piogram 



1914 and Igj NAEf Surreys 



Student lik dumtd tuiilci |1>SI-.X| 



Student file derived i*.e ||)R AC:E| 
Btatk.au* I l»pank 
Hispanic 
Native Amcmoii 
Asua Americaa/PA-ilic hUuki 
While. aualli>|umc 
Oihci 



Only in en.tu.lcJ iiuJeni lik 



StSGintfKttnc Mother. UlUi educutf 
(B0U3SUI A. BUU360I Al; Reading 
autertolt m home jBiMWU A 5 Al 



M*h. KKtKC. leading KWtk. 

(MPRCOMPt 5.SRPCMPI 5. 
RliDVAI.I 5| 



Excluded student suivcy |XKLASON=2| 



Student attitudes lowuid gcndei A o\Mb 
•14: & 3|S20YIOMj(. OV 7 |S202202B 
5211**11 G» IUS2I2UU2M 
Or7&ll|S202Wft: S2t»)U60| 
l*m Of 4|MMItliflU| 
Grl.l2|M«tH7Ulb| 



Transcripts and Surveys Linked 



Ml US&B Sock Tgmcrlpjs 



Gender balance ia voc ed prugrann. 
but jus* thit cohort 



1M0-S6 1IS&B Sopk Surveys 



iMIhkl i si X| 



Hac eiluikiiy IRACEJ 



HSAB oMDjknue viiubk |1IANDK:AP| 
baaed «*i ic|hmu «4 handicap t« part**- 
m handicap p* ogiaia* 

||SABi.ikii|h4H« variable 
in quiit tiki 

In vait<m> It i program* m Cii III 
(BB0I4A H.Mtft 12 IFYIIA t| 

HSAB j%%«iitncm score* |1 i:S»QJ 
in qua ides 



front GI»A mi tunn-iipt study iif tell rep 
if nottaiiM.iipu ItlSGRADESI 

Eugluli (MOMM ANG=4 b| 
Nm English |IIGMEI.ANU-I-3| 



Marital stains I r Y4I J and hiitmy |TY46 
TY47CY2|.ih.kHca|TY49TY518| 

Dcieiiiiincd IttMH cnip/cd hiiury 

Oetctntiitcd (mm niai sui. entp hit* 

ikittkf bgl^nue in <x«. upj*H*>. 
but fust Ihn cidiiat 



Stfc trade »ase-Ye»r(lj 



C«ntt|Nt>tU- tiritdil ISI > 

CouiiHuitc Kac IRAC I 
lliipawc Subgf«Hips|IH2 



In pa>i IuihJk jp |»i>g (I I ANI 
Pa cm R« poll | BY HAN I) 
Te»:beiRep«witbYI,ANI 



SLSi«Mi»l>ii>ne|BYSP 
SESbyquaniktlBYSE 

2ndRl.ilinTjlentS«JKti I 
B«H«id. «k Mbci pr«tgiatni in | 

Sundoidued coni|Hntte id ie. 

m«ktBrrXCO»1P|.ia^ 
iBYTX04»RT|. <i*tr deiwki 

ie*kag. nu«h. uiente 

(iudcib «|byc;rai>sby( 

Giadeiy-l2.la2i»dloHuw»i 

L^tgujKC in Ikkiic JBYIIM 
htEP(BYIl:Pl 
liUngtugcaiiatmtyli)^ 

in IM ^nd lotci UAU\* 



(U>lttHlt««» ytHiug) 

kiihiwt Out ytRing] 

Eitiuuicd gcndei tu|jm.c i 
Percent gcndei | SEX | oi tin 
vanous k%eb A typo vt w 
(.«HMtCt |iti Uanvtltftk M» 2nd 
IW2| 



— imkcMct 4mm • 



mlMc m lint djinel 
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Table A7 

Secondary-Level Vocational Education Variables: Vocational Teachers 



Cnncots in4 Indict tor* 


IW7 Tn— /Wven Hd Uafccd; 
IM7 IM&TTfeMCtlpf turfy 


1 WO TraM/Smvcn Witt Be Lifted 
HMurf IfMNAEP S«mt 


Transcripts and 
I9C2 HSJkl San* Trsnncrfcli 


Surveys linked 

19M II IISAI Sank Surreys 


NELSII 

MM imc MWinr if 






taton nf MMtfetto U tunalc *■> 

Nit VtCAlHHUl K^HCH 






T— thm nf >wn»u U n*f 

No *c«fc»al tCJtnei : 


Demographics 
Gender 


- 


N«H« 1990 Nouxki mlul.M Gf 12 
|H* »Mi ecmnco m Gt 1 1 i<««kmu 
CaHkr|T<X>uOUI| 


- 




<kmlo |BYI ) l( 


K»cc ElhnkUy 




U u «■ ,i|,ni. ■■ v 1 f IK W> 1 111 I 






H*c«h«Kity |BYI 1 


Ace 


-■ 


A*c |l(«K.i(ll| 






* iuvr i ivi 
A|C (Oil J JI| 

1 yc« (Mfc iri ItfflkycJ 


Educ*iio**l Background 




HighcM(k V icc(IUK»l(UI| 






Higticil ilcguc (UY1J 


MftJnrFkMnf&iMly 




U«4cf|t«4 nujuf m Huth | I«Ml7tU3I 

rUM-flWM* MMy HI IN»1IWIW| 






BA nuj/iweeachM*! |»Y1 J 
•V n.*«| 0**1 MejftMft « 

HYT3jOAi>-irn_K 


Type nf Credential 




Sl4c (.chUkjihxi hi nuili 1 IU)M4K>| 






TypcuftctliOciclBri] 

CcrtrfMcwk 3«bj(tY13.; 


Tucking History 
Age ftcfanTcaiMfit Full-Tin* 












Yean nf Eftpci knee Teaching 




Yc«»u<MI iiiik »c*liiii||TtXI6MII| 








CmtrtM Tttcklmg SMfHi 
tleUnfTcaefcfcnc 




Duly itulh. xiciMt. iciJiCik ul 
Wnacnu m UMiV kJ«nr4e 






Only Lflglutt. uudi. kumk 
muni »«atc* feacneil «f Nl 
(ample k tin. 10* « 

fc.K«CC K*h»l U Uttl g 



— MicMit *au not available In inii dn-ntf 
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Table A8 



Secondary-Level Vocalional Education Variables: Organlzalion of Vocational Educalion Delivery System 



■ ndl l*4ktf%n 



to 



Types of Institutions 
S(.wlT)pt 



Tttmm Offered 



Dcfl*M««*f V*c 



IH7T«M«yfvtf«NaiU>t«4; tWO Trani/Swyi WiH g« Lwtcd 



1*7 NAErTli«trM»»JT 



School typclSTYPEI 
(publk. prfvm. C**e*c SI A) 



1*4 —d IjHWAEPSMfgfl 



SiuOaMfiklSUHYrtil 

ifii«issciiryp| 



fine rimi md Smcvcyb tinted 



StW iype(IISTYr«i 



•Ml svMUUt *it dMM 

j| li n n nTT 'r nti l*» unit mi iluiikt^* 



MiM|«ncMi tor delivery uf ucomliry vuc^ional ciJ«c»ikM. 



NELSM 



(puMMJCaikutti^invaMV 1 



7*1 fullowup. il My u< I 
M J pf uf ( j«u • vhLMc * 
district 

2nd Ml«iwup V«x.c»hm> 
{mM Nfk * hod. tree i 

KlMMl. C4MMHHd4yi< 

2nJ Miuwup. ItM <dd 
(tftAitMJ UCdCMUl. Cui 
of CM* Ml. «* I 

ccwncftf citdiu. M»* 
Mliw «ut*er * cam* 
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Table A 9 

|»osl&ccoii<lary level Vocational Education Variables: Progi am Participation 



CanetfrU and Indicator* 



Student Demotraphks 
Imputation 



^cutler 
fUce-Elhnklly 

Age 



Mrglu 



EdiKafluiwI AllalntlKm 



fartnt'f Education 



lllgli School I'rugram 

Secondary Vocational 
Education Counts Taken 



PSE Hans 



Ubor Mai kcl Pai iktpillMi 



crs-Oci i»t 



Current fipuaal Ion Surrey 



iviIija. mmin»uiuuu»aiucJ ElI-1 YI'ERf 
Hotkb|kKhoul|MS3I| 

Gc>hIci|U<*I| 

Race 1 1 If | 
(*igi*|IIX| 

Age (III)} 



Sumy: 

FjllcnrnlliivMtlKHiiulin U )| 
E*toltineftu by type of tntmutioa 
jhrfroEf FaUcMhJIntfrtMixcufuliiNi 
»lly sptolic jxufrjnu. by i*»g. fJC«| 
I MuHtttcKU Ktf.it jicly «««". women 

toioltiicim by u«.< cllinu tiy 
UUI.Hit^K N«u«c Am Allan Am 
Wlmc 

kmiJIiitffiitby let <nd Jfc 
(A|ei.<ll. II 19 20 21.22 24 25 
29. 30 H 3) )4 AH «* 50 64. 6S») 



Lut^dyc J. unemployed. *** m l.»b»« 
(an*(NILF)IAMAlACf| 
Employ me* level |A-IIRSI 1 
rulMunt (lS*br >); Puvttnw (<3i nnl 



Intcirakd fSE Pan Syrtcg 



Toeie transcripts and survey* aie linked 



|»M HSntB SenJf Conort 



PSETraaacriptodfM) 



Hum Sctund lUkmup I I9IH) 
1 bo* wbo aiieaikd fSE by iyt4 



19— HS&B Senior Cohort 



S W r rcn;19B»,l2,H,Bo 



1 1 lbuJhil!iiwu|i<rJXM 

llnoc »h» jiicnJcd fSL by 1916 



CntJci |M:X( (>MI'i<2iKlMD 
H ue ell*imny|HACl:2| 



( at. uljic «gc (mm innhJjie. 
IBIK1IIMO. BIRHUM. BIRTIIYRJ 

K<|i I high Hla«4|IISIHV| 



tJui Jih.n dii4innicnl by ca|i »ui*ey 
ItDATTAlNI 



hitcul* cJuciifcM |PAREI>UC| 



iii K h x.i»*«>a |N«vm iimcMi2| 

IinA -ny coucse in 20 vutaitunjl 
Keu|RtU>«A Ql 
Number <4jnot cuursc* fca: B mines*, 
latea IkMIMIIJ. Tiade A M»dJfcB«Ml|, 
rtchnical|bU«MI|tk»*f «c|EBUMK 

I'bLfUioll'SI II ANSI 



PSE Transcript Sim 



loose vtbu attended I'Sl 
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Table A9— Continued 



|»oslstc«itclary Level Vocational Education Variable: Program Participation 



> 
i 

4^ 



14; 
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Concepts and tndkalnrr 



Type of I'SE Mtendtd 



PSE Enrollment 



PSE Enrollment Uvel 



Taking Counts 
Cunrtt DdlaOTmftorny 



Program T)|>« 



Vocational Frogram Categories 



tWite Earned 



Program Tj p« 



Vocational Pi ugr^m Categories 



CPS -Oct Iff 



Currce* Pop***** Snnrty 



fublu in |hi\jic|KI bill 
2yeai c*4ye*rcejek|e|MSM| 

tti«Mypes(MS4Si| 
VoLitional. trade, lech, uc UuincM 
Employer 
All o<her 



Takiag vocational courses-' 
Wcrtiag <*r~ |M-SI5|. 
Associate (AA) OCCUr**ioeal 
Other license, diploma, or certificate 
Takiag aay butt****, vocational, 
sccbssfcal. secretarial, trade, or 
concspondcafe courses |MSJ6| 

Full umc or port umc |M Sll| 



tnttf raled fSE Dala Syilcm 
Survey: 

MIciHitJIiirMilhiiiml.n II )| 
Ifiyhoi JcgA.Cti .uicicJ llll.HI H R|. 
Let* ifcm I year, nute thaa I year and 
Less than 2 years, more dun 2 yean 
and Itit don 4 yens. Asstcuie Dcg 
flEVEI-l I cm iIlm 2 year> 
2 ycarjur nn«e. ku than 4 ycul 
|CONTROL| Public, pmaicaon prut'it. 

pltVJtC. l«W p4ofH 

(SECTOR) IcvclaVumifid 

ItlllibuwJ 

Enrollment* by l>pe ol institution 



IPEDS 



Survey: 

Fall enrol linen I in ©ccupaiionally 
specific programs 



Inililuluiu i>j>c(i) MllcihkJ VJtM V4 
||NSTYP£| (rVopnciary. private tec* 2 
p. public stc* 2-yr. puNk 2-yr cotkge. 
private 4 yr. public 4 yt) 



These transcripts and surveys ate Itnlcd 



IgjQ HS&l ScwIt Cgfcgfj 



rSETr»iM<rlPli<W<) 



Cuuims attempted for all tvpe* ol 
PSE tnaiitvtkau 

CrcJm earned in courses in public 2 yr 

IM'.ilUliOAS 



Courses attenuated at all kit Uu*4 yrs 
Cm* set cwplurd at put 2-yr oaly 
Taaoftomy for kss than-4-yr Insu: 
6 digit comic CIP code |CRSECIP| 

TiAiKMMny for less than 4yr m»u 
from course CIP code |CR SLOP| 

Academic vs. vocational 
Taxonomy for kss than-4-yr tnsu. 
fc mi couth CIP code |CRStCIP|. 
10 voueitoAat course categories 

Courses cotnpkied «i pub 2 yr only. 
Tuoftooiy fur kss-thaa-4-yT msu 
Course CIP code ICR SEC IP) 
Course ctediu possible |CRSECRED| 
GxiAt leccivedlGRAOTYPEl type 
(CRSGRADtJ numeric 
(CRSGRADA| kHU 
T*tunomy lor kss than 4 yi mm. 
Rom course CIP smk fi RSLCIP1 

Academical vocational 
Taioaomy for less Hum 4 yr mm 
Rom course CIP code (CRSECIP) 
1 0 visional course categoricl 



MM HSftB Senior CoMrt 
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Surveys: 194)0. 1 2, §4,-3 



limit I ii %l iluuufli Nut J I ukWups 
laklih.uuo ijpeft) nneuded IVWI M. 
Kind nf Khoot \mm, IB5JR2. 
IEJ)b). h£3JB4. FEJJB5. SEIIA. 
SEiyA.SE20A.TE2IA.1E22A| 
(tik.4tii<iul/tt»de 2 yi.4 yi. tidier) 
luiu.d id SChmd|ll:Jliil. IUJKj2. 
tt:J)0». I1-J3G4. FUlKiS. SEliB. 
SEI9U SE2UB.TE2IR.1E228I 
(Public u( privjie) 

|i»titiiii«ms MUcndcd (jcc above) 
Type U degree giul (we below) 



H«m Hnid FolkmypU g »6). 
hill time siudcnt or not (TE2IE. 
TE22EI 

Type «f drfiec goal |1E2 III TE22II| 
(Cert, degiee vie. 2 yr. 4-yr. e*J 



l ieMul study (TE2IC TE22G| 
6digliClPcodc 



These um 



NLS-72 



PSE Transcript Slud 



ItnliluliiMi ivpc(s| Micnik 
|INSTYPE|(Vocaito«a).| 
vi«;ai*oaat t public scad 2< 
atadernic4.yr.foiei|jri 



CtMises atienipied (or J 
PSE msuiaiHMi 

Courses Completed, cicd 
at public 2-ycar instil 



Courses attempted al kss 
Courses completed at put 
Taioaomy fur kss ehm- 

6 digit course CIP code |i 

lrfi«in«mty for kit ili-m 
(torn course CIP Cede ;t 
Acadcmkvi vocj 
Tjiooomy for kss than 
from course CIP ci«k |C 
10 *otatio«:d tours* c 

Couiscs coutplcied po 
Taiontimy lor kissbai 
Course (IP code |CI 
Course credits poisibk |C 
GoJc received |GRAD 
|CRSGRAO»I au 
(CRSGRADAl ( 
Uttinomy lor kss iK*n 
turn* t nurse CIP vi«de (> 
Avadc4tm.vi »<«-j 
I jaiHUuny lot ksk ih«i 
front course CIP uukp 
HI »ot»u«inaliOurve i 



i'Sfc* Trantjeri 
>Ym» V»c E4 to Other 



Program Completion 



l.ctrl of l>c|iccs 



cfsoci im 



Type. *f Degree* 



fiilor Afa/^rl Participation 
Type of Employ ntcnl 

|*tcl ol Employment 

7f0W/7> Waff* 
*y Ltvri «f £iH#*ayH*ttl 



CwttH faaaattlaatanrey 
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I'ostsecondary Level Vocational Education Variables: Student Outcomes 



mm 



l»i»HSJklS««aar Cih»rt 



l9»H3*IS*oUrCe*«rt 



T!*»e 



Integrated WE Data Sglg 



«ETrwcrta4<(lH4) 



Siutcjr niitipkUiMu 
I totl .4WKi>uf> |FO«MTYPfc| 
CI. 4 yc« 
C2 2 thfwtfh leu tfun 4 ye* 
C3. k»» than 2 ye* 

PjjIA deftec* l«bw MA/US. 
C*U|uiici: k»» auii C-ytariu 
2 yc« awuutti ksi aun4-yc« 
$cpa»cty »y tk|iccs. 
tty f<«tkl ftiftJ eUwkiiy 
CoauoJ. puM* *» pmMle(SECIOft) 
iy level ufoHeniigl 

LkK«ciy|x field of study 
• digit 1 Ifvtxki 



sgew g imim.K 



PSETrttwertplSjM 



Uy (iompuUK2 ye* «u rttici 
I lit. ||ty|*<tfrS£faiiNiiHoM«ttta*J 
riiwi l!M0lhftM»gk 



t l»e I) in* «•< Pit imiiwm* *Ki»»k4 
(iiMil9Mtftf«Ni|fc 191* 



( ,.i. r lci<J Jcgtcc» «iJ i«imIk4ks 
by 19*4 

I ««d i4 ikt«« )Mrfri<«< f«* |SEf II. 
ililvl.$t2<H. TUIII.21HI 
<icrtiuc«c. 2 ye.tf.4 y<*. other) 
C'oinpkKiiN tt«|SEISI. SEIW. 

sew mil. mi 

UImiTmU Wh»*m» viiwWci) 
ti*l<J U Mudy ul«rtrffcj*« « *tgte<t 
Jkjv«|SEIIII.SEIVH. SE20H. 
1t!2f<i.22G| 
f.4»|il CU' code* 



E«,f4uyimMMl9ll. 1914. I9M 
L.u^ytrf. w«««*>ye4. •« at U*« 
IFEIA IJ.SEJA JK.TE3A-JKI 

JIU4A9 E9. SUM. Still. SE«I 
SEVM TE1I 1£9I. rEl«. reUI| 
lltmcly wjf«. itumnbyM PI 
||I:24A?K lfcMfc9.SK4? *> HA I. 

rem haii 
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Table All 

Postsecoiuliiry Level Vocational Education Variables; Special Populations 



Thcic irwcrifU end HKvcy* arc linked 



That trait*: 



Ceoccpl* —4 Indkitort 



CPS «Oct l»»t 



Carre*! Pe^etSrtieai Stmy 



jjjg ltS*l Stater Cjfcotj 



19t HSJk» Senior CtWl 



NLS-72 



liMetraied PSE Data Syrieta 



Sw*er*: t9#a,«l t $4,»4 



rSE Transcript Study! 



Program Participation 

Gender 
Women 

Race-EthnkiSy 
•feck 
Hfcgtaak 
Native America* 
AaIm American 
W*Me 

Uandkapped 
Hindtnttrd 
llaadka* Cooafcioa 

•xmnomkaUy Disadvantaged 
SIS 

ducationally Disadvantaged 
A« 



15, 



High ScImmI Grade* 

ffome Language 
IXP 



Staff* Parent* 
Aduki Needing Retraining 
Displaced Homemakert 
Sex Equity 
Incarcerated 



o 
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Taking vucaiinnJ ctwi tct 

See Table AS 
<a**fc<|tl0tj 

aac<|tti|.Ea»!icuy|ISK): 

BUck.MHI HlSfUUC 



Native A« 
Aum AmcncM 
Wki*. MN-lliipMii: 



Hartal Sialitt|Q»t A) 
Km nmrilwliilil cMU |QM!| 



Marital $uu*|QvlA| 
(UtikldtfiaMai) 



Survey*, ciuultmcuii I'lmtplciiins 

Of CfaJI eaiUlnuaU 

Women, inch (pjn »4 vaiubfc name) 

Itacc-cilttfcHy (pan uf vanablc new) 
Black, mm Idipwiffi: 
Hispanic 
Native Aa&Kw 
Aium Amenta* 
WSitc, hum Hupenic 



CtHMkcs dicitipicd andA* completed, and ucdih ejincd 



In voc cd prog lam* 
g dkiftcaiwi 



Ikndci |SHXCOMP| 

Axe eihnkiiy |RACE2j 
Slack 

IHsfMMMC 

Native American 
Aujh A went an 

WkHC 



If aftdhafpal. in handicap p««>gfdm 
IIIANOICAri 



HSie CunHMttiic. in ijuaiuks (SESQJ 



ItSSa A»c»iiKnf ktiNCk. in t|«amks 
|TE$TQ| 
IISAB CiMifOMle IHSGK ADESI 



Othci khan Lnglnh |UOMEI.ANG| 



Mamal statu* IfrbSS. SEJ7. TE4 1 1 
CtfaJrea |FES2. HBttA. S£a6. SEdaA. 
1E4*| 

Dctcinunc frtMfi efeeduy/cduc tuiiiMy 



Ocicmutic liuiti marital »tai. enip hilt 



ticndci balance in v«w ed pittgk «*.c» 
•Mmwg tldtCtdviet 
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CouriCi attempted and 

(kndci ICSfcXI 

Rate ethnicity |CR AC 
Stack 
Itbpaaic 
Native American 
A wan American 
While 



■ax year SES conqxHtic |B 



Saw yew «cm kmc (aicgti 
bi«K low. MMOMe (BYTE 



Gcadct balance m vuc cd pt« 

fAlStftUdMlrttMtr 



Table A 12 



Postsecondary Level Vocational Education Variables: Vocational Teachers 





Thcic UanwtijMs and surveys ate linked 




CPS -Oct 1990 


IPEOS 


1910 HS£8 Settlor Cohort 


ItU UCf>tl C*.l>u- PnltArl 

19M If 50x11 senior conon 


Concepts and Indicators 


Current Population Survey 


Intetrated PSE Data System 


PSE Transcripts <I9S4) 


Surveys: 19*0. 12, W. a* 


Types of institutions 










Demographics 


- 


- 


- 




(•ender 
Kacc-Elkiiiiily 
Afe 


» 








Educational Background 
Highest Degree 
Major Field of Study 




- 


- 


- 


Current Teaching Status 
Kiel* •(Teaching 


- 


— 


— 




Teaching Time 

Academic Rank 
Salary 










Teaching History 
Age Began Teaching PSE 










Years Kaw Tvatliing VSE 
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Fostsecondary Level Vocational Education Variables: Organization of Vocational Education Delivery System 
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These iransaijxs and surveys are linked 


Concepts and Indicators 


CPS -Oct 1990 


IPEDS 


19S0 HS&B Seninr Cohort 


19M HS*B Sealor Cohort 


Current Population Survey 


Integrated PSE Data System 


Pof (secondary Transcripts 


surveys: iywj ( »• 






Survey liiNiiiuii'iit.i! iliaruili'mfics 






Types of l*SE Institutions 


- 


PSI; iiiMiluuous olleriii( vocauotial 










education |PF.OIISTR|and: 










4 year, public ic private 










jliJUl ICI PUIiI.IC9.PRIVAT|j2|aiid 










|1 EVEU l.EVtU I J 










Public 2-year: 










jl'OUl ICI PUBIIC9) and 










ll.fcVM 3 I EVEWI 










Public vocational -technical 










|PUBI ICI-PUBt rC9|and 










|t.EVUI-t.EVEL2| 










Private propriety 1 PRIVATEI| and 










|l EVULI 1EVEL4I 










Private lets than 4 year (IKIVATE2| and 










jlUViil.U.UVEMJ 










NOIL. Variable* above = 1 or blank 










Include in above group* if-t 










By stale (ST ABBR| 






Programs Offered 




6-di£ii C'll'iule of 3 Ijfficii piojrami 










,C1PC0I>£I . CllttHlEl. OPCODE!! 






Degree* Awtuded 




Sic 1 able A 7 Student Outcomes: 










Pr^nm CftMpldlMi 
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Tabic A 14 

NPSAS Postsccoiulary Level Vocational Education Variables: Program Participation 
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a 


NPSAS 


Concepts and Indicator* 


19*7 


1990 


Student Demographics 
Population 


Student* in M typo ul PSfc institutions 
ia uadcrgnd. graduate, fast -prof progs 
Sampled Ociobei 1916 only 


Siudctils in all i)pv» ul PSE institutions 
In uadeigfad. graduate, fust prof progs 
Sampled throughout year 1919-90 


Gender 


Urnlci (SbXJ 


Ch-iuK-i |C il.NOI.lt | 


Kacfr-Elhnklly 


R*.e cthniLiiy|RACE| 
(Name Am. Asian. Slack not Unpin*:. 
Iloponic. White not Hispanic) 


K*c etliniuty |KACfc| 
<Naiivc Am. Asian. Blaik nut Hispanic. 
|ll>paiiii.. While not llis|unic) 


AtfC 


Agc|A(i| | 


*ge|A<il.| 


Region (By State) 


Student* lta.il icuJcnic %uit [Hi UCAl S T| 
Student i leg J resident tutc |RPEftMST| 


Student * local suie (Iiiun II'LDS lusliiuui ll>j 
Studcm s legal lenJem siatc |HOMSTAl fc| 


Edu<.4(tOlial 4lti(lllllCltl 


( uuent atadcmn lc\cl (K2Ij| 
(llodeigiad 1 vi ycai. uadctgrad other, 
pott bac 1st prof, mutters, duct othei) 
Uudcigiaduate year |S36) 


Cuiicin oi.i.U.'iitii level \Q2 l J\ 
(Ihidergrad I si year, under grai other, 
post bac 1st prof, nutters, duct, nthei) 
Undergraduate >car |UGRDLVLIJ 


Dependency tutus 


Dependent t* independent (manually 
from parcau |R2SJ 


Dependent tic independent (manually 
fiompjicnu (DEPEND) 


sts 


Faintly bocltgiound 
For dependent and indepcadent students 
separately. Use: Depeadeat studeat's 
income (DbPINCJ. Pareat's education 

|S99_I.S99_2|. SEI scores of 
patent's occupations |S97f.:DE,S9iCOE| 


Family bailginund 
For dependent Aitd ladcpendcm students 
separately. Use: Dependent student's 
iacome |DBPINC|. Patent's education 
IFATIIEDUC MOTKI:OIJC|. SEI scores ot 
parent's uLCt|SOt:DAD9U. SOCMOM90J 


Parent's Education 


Parent* highcti c duration 

|iii|ii.dsw.i.syv.2| 


Patent s Incites! edm atiou 
JIAHfcUUCI 


High School Itegicv Type 


Hi^h u h*»4 diploma ly|>c 
IIIISCllDfcG] 


Ih^ti uli»«il diploma lype 
IIISlMiO) 


lli^bcvt Education Ex pi tied 


Highest education ci pec led 
|S«I 


lli^liol cdui atiuii cij>CLicd 

(EXEOCCM.I 


Labor Market Participation 


Wixkmg fu pay in not 
|SU •*) S46| 


WirtVun; In! pay in nut 
jl.MSI AT) 



Table AH-contlnued 
NPSAS Poststcutidary l evel Vocational Education Variables: Program Participation 





NPSAS 


Concepts tnd Indicators 


IH7 


1990 


Type of PSE Attended 


Ixvcl andcnciu^lVTYM:! 
(Piivaienot foc-ptofiMyT. Publk4-yr. 
Private not fnr-ptoTri leu- than 4- year. 
Public 2- 10 3 yew. Public vu-tcch. 
I'rtyiiciary) 


U«elandciiiiiiul|OICONI| 
(Pnvate aot-toi prof«4-yr. Public A yr. 
Private sot foi pnifM kss than 4-year. 
Public 2- ki 3 year. Publk. vu loth. 
Pt«i|Mictity) 


PSE Enrollment 


Working luwjid UeKfceA.cn 
(Cert/award. Diploma. Associate'!. 
Bachelor's, Post-Bacc. Master's. Doct. 
rirstPrulessional. Undecided. Other 


Wutkiug umjid dcgiccA.cn IPWKJ 1 YP | 
(Cert/award. Diplunu. Associate's. 
Bachelor's. POsl Bate. Master's. Dou. 
Fir>t>Pi<ilcssi<Mial. Undecided. Other 


PSE Enrollment Level 


1 ull mi* «r pun tune |ATTNSTAT| 


hull tin* ♦« f-ui tunc |AITI:ND| 


nttitur t Fw^fUfii rnw 






Prof rain Type 


Major of field of study 
|MA)CAT| <2-di|itOPcode) 
|S37CD£| (6-digh CIP code) 
Cltkk ttf undents |R20AICI>E| (6 dig) 
Credit students |K2IFet>E|<6 digit) 


Mjjim itt licit! til study |MAJOKS| 
<2-d<|ttCIPc<4e) 


Vocational Program Categoric* 


Agucullure. business and mIikc. 
marketing and distribution, health, 
home economics, technical education. 
u.kJcj and industry, yndcfincd 
vocational 


Agiiculiuic. Ihisiiics) itnd fdlHC. 
markclHtg and disinbuifcM. health, 
home economics, lechnkai education, 
trade* and industry, undefined 
vncatnifljl 



16 L 



ERIC 



BEST COPY AVAILABLE 



Table AI5 

NPSAS Poslsccondary Level Vocational Education Variables: Special Populations 





NPSAS 


Concepts ia<J Indicators 


1987 


1990 


Program Participation 






Gender 
Wna*. 


Gender |SEXJ 
|SEX«2| 


(wilder (GENDER) 
|GENDER«2| 


Race- Eth n icily 
Native America* 
Asian America* 
Mack 
Hispanic 
While 


R*cc cilifiicily |KAC£| 
IRAC&-U 
|RACE-2| 
|RACE=3| 
(RACE-4| 
(RACE- 51 


K^c etliilMI) (KACfcl 
|RACE-I| 
|RACE«2| 
|RACE*)| 
(RACE-41 
|RACE=S| 


Handicapped 
Handicapped 
Handicap Cnadltlon 


Disabled** nut (SI2| 
Type of usability |St2| 
(Phy>n.al. learning, multiple, nunc) 


Dualled of nui (DISABI.TYI 
Type uf disability (DEAFNESS. SPtECH. 
OR RIO. VISUM.. IIEALTOTH. 

I FADNdKl 


Economically Disadvantaged 
SES 


Family background 
Fur dependent end inlay telmt undents 
separately. Use: Dependent « intent's 
Income |D£PINCJ. Parent's education 

{SWJ.SWJl SEIscoresof 
poicM'i «ictipatioas |S97CDE.SyiCD£, 


Faintly b<fc.kgftujnd 
For dependent and independent uudenu 
separately. Use: Dependent undent's 
income (DUPINC'l. P«/cm'i education 
IFaTHEDUC MOTtllUMKD. SE1 haves ul 
fuiciu'i otCklSturOAlMKI. SOCMOM90| 


Educationally Disadvantaged 
PS t CPA 


Pali giade |h>Mit iivcuge | VSTDK2 U>| 
(fur c< tail bo* undtnti only) 


I'afc glade pvMiti jtCMgc Hil'A| 


Single Parents 


Mutual iiaiui IMAKIl'Al | 
Numbct uf dependent* |S79J 


MmiIuI ><jiu> |MARI 1 Al.. NUM(>EP| 
Number uf dependents f NUMDEP f 


Adults Needing Retraining 






Displaced tlotnemukers 


Partial ileliniuon: 
Mania! amrtlMAIUTALI 
Hmbet at nVptndeatt |SW| 


VmUjI definition: 
M.u»ul uaitfi lHARtTAl.) 
Number <** dcpenileau |NUMDEP| 


Sex Equity 


Pccccnt gender | SEX | 
ofmnjor(MAJCAT| 
by uudent acneenac level |R2la. S W| 


Patent ycndet(Gl:N()hK| 
o( men* |MiRCOOE| 
by undent w-kn nc level (UCRD1 Vl.l | 


incarcerated 







APPENDIX B 
SUMMARY OF STATE MIS PRACTICES 
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SECONDARY 



Issues 


California 


Colorado 


Idaho 


1. Status of data 
automation 


Secondary-level data relevant 
to vocauionaieciucaaon are col- 
lected by several different agen- 
cies within the California State 
Department oiXducanon. Gen- 
erally, these data are submit- 
ted to the state on handwritten 
standard paper forma or on 
bubble forma for electronic 
scanning, although some coun- 
nea/dlatztcttauhmitthetrdata 
on floppy disk orrragneoc tape. 
Therecervmjf agency tnputs the 
data into us database. Most of 
the data are submitted in ag- 
gregate form for individual 
schools, districts, or counties, 
but can be linked across data- 
bases using unique school- 
district-county codes. The only 
student record truonnanon col- 
lected at the state level is for 
students with disabilities. 


Colorado has an automated, 
integrated, student recorddata 
system that includes both sec- 
ondary and poatsecondary 
information. Districts submit 
student records to the state on 
a diskette or tape using a soft- 
ware prc^ram developed by the 
state. Several years back, the 
Colorado Comma may College 
and Occupational Education 
System (CCCOES) provided a 
personal computer for every 
district tn the state: currently, 
every district but one has a 
working computer. Thus teach- 
ers or schools enter the data 

lection form. 


Idaho does not maintain stu- 
dent record systems at the 
state level. Local secondary 
agencies report data to the 
State Division of Vocational 
Education on paper forma. 
These are then entered into 
the state's data system, which 
maintaina aggregate data on 
each agency. At. the local levei 
the extent of automation var- 
ies among secondary agen- 
cies* Types of systems differ 
among schools districts, and 
even among schools within 
districts. 


2. Levels of 
vocational 
conrsetaJdng 


California makes a distinction 
between advanced and intro- 
ductory occupational pro- 
grams, which are administered 
by different agencies within the 
Department of Education. Ad- 
vanced occupational programs 
are administered by the Ca- 
reer-Vocational Education Di- 
vision (CVE1 and are offered 
through Regional Occupational 
Centers/ Programs <ROC/Psl. 
ROCs are the equivalent of area 
vocational schools, while ROPs 
offer advanced occupational 
courses in regular high schools. 
ROC/Ps serve ooth high school 
students and adults tn the same 
classroom, although the dis- 
tinction la drawn between 
ROC/Ps serving adults and 
adult education vocational pro- 
grams. The latter mav be of- 
fered by ROC/Ps. counuee. 
school districts, or community 
colleges. All introductory oc- 
cupanonal courses, including 
consumer and hemcmaJung 
education, industrial and tech- 
iwjwwpr cQucauon. ana some 
business courses, are consid- 
ered part of CalUorrua second- 
ary education and are offered 
as part of the regular high 
school curriculum. 


in Colorado, vocational enroll- 
ment is counted by the num- 
ber of students tn an occupa- 
uonalty specific vocational 
course. Pi c- voLaoonal courses, 
such as career exploration, are 
not included as being occupa- 
tional^ specific. 


Idaho extinguishes between 
'specific labor market'' and 
"general labor market* pro- 
grams. Specific labor market 
programs are those approved 
by the State Division of Vo- 
cational education for voca- 
tional reimbursement (t.e.. 
statecategoncal funding). The 
category includes consumer 
home economics and teen 
parenting classes because 
these are eligible for state 
funding. Enrollment in these 
programs can be isolated if a 
more accurate estimate of 
"specific labor market" were 
needed. General labor market 
classes are those providing 
general labor market skills. 
These include exploratory 
classes and general skills 
ctaaaes such as Typing 1. 
Introduction to Business 
Computers, and General 
Welding. These classes are 
not currently eligible for vo- 
cational formula reimburse- 
ment due to lack of state 
tunas. 



B-l 

lg s BEST COPV AVAILABLE 



SECONDARY 



Issues 



3. Ability to provide 
duplicated and 
uadnplicated 
counts 

a. of ail students 



California 



The CVE collects annual en- 
rollment data, trom each ROC/ 
P. Total enrollment is reported 
for each course, and is broken 
down for high school and adult 
students. Although students 
taking more than one ROC/P 
course would be double- 
counted by CVE in a total en- 
rollment count lor the state. 
ROC/P administrators believe 
it is rare for high school stu- 
dents to enroll in more than 
one of their courses in a given 
year, in addition to CVE enroll- 
ment counts, the California 
Basic Educational Data Sys- 
tem (C8EDSJ collects annual 
enrollment data for secondary 
education from each county 
and school district. Since coun- 
ties are the responsible fiscal 
agents in California, they pass 
funds for secondary education 
through to the school districts. 
Some counties also administer 
educational programs, such as 
adult education and ROPs. 
C8E0S requires that each 
county and school district in 
the state reports enrollment 
at the school level in the voca- 
tional education programs it 
oilers. Counties are directed 
not to duplicate counts for 
students concurrently enrolled 
in a school district, and coun- 
ties and school districts are 
not supposed to include ROC/ 
Ps in their enrollment counts, 
(However, it is uncertain to 
what extent counties and 
school districts independently 
offer advanced occupational 
courses that are not part of 
ROC/Ps.l Only the total nunv 
ber of students enrolled in 
county/district vocational edu- 
cation is reported on CBEDS 
forms: no specific program or 
course enrollment information 
is given. Course enrollment 
data is also available from the 
CBEDS faculty assignment 
forms: however, these data pro* 
duce duplicated counts of stu- 
dents enrolled in vocational 
education if aggregated across 
courses. 



Colorado 



Colorado has a student record 
data system at the stats kvei. 
thus has the flexibility to ag- 
gregate and re-aggregate the 
data to provide undupl tested 
enrollment counts of students 
both within programs and 
among prop ante. Pt ogiamsare 
defined at the stx-digttCIPlevei. 
and students are assumed to 
programabaaedonthetr course 
enrollment. However, m cases 
where the student is enrolled 
in more than one program area, 
the state uses an algorithm 
that assigns the student to one 
program only. 



Idaho 



Idaho can provide undu- 
pUcated counts of enrollment 
in programs by tuto^digit CEP 
code only. Locale are mid to 
count a student only once. 
Students are counted first 
in specific labor market pro- 
grams. While there are no in- 
structions u> locals about how 
to handle a student enrolled 
in more than one two-digit 
specific tabor market pro* 
gram, presumably this occurs 
infrequently. Students are 
then counted m general labor 
market programs only if they 
are not enrolled in specific 
labor market programs. 
Idalm also collecm duplicated 
airoUment counts by stx-digit 
code. It does so by asking 
instructors to report enroll- 
ment in each class assign- 
ment by class code. The 
instructor reports actual 
enrollment for the first 
semester and estimates 
enrollment for the second 
semester (or in some cases 
the second and third se- 
mester for places using a 
trimester*. These class en- 
rollments are reported by 
total only: there is no at- 
tempt to distinguish by 
race. sex. or special need. 
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Kentucky has an automated 
student record system at the 
state level. Movement toward 
automation is occurring 
within the Kentucky Tech 
system (encompassing the 
state-run secondary area vo- 
cational centers and the 
postsecondary vocational- 
technical schools). Four of 
the Kentucky Tech sites have 
been computerized as pan of 
a pilot program. At these pilot 
sites, student data are en- 
tered into the on-line system 
at the local school. Student 
data tor secondary school stu- 
dents are passed to districts 
on paper forms for districts to 
input. 


The Michigan Department of 
Educaaon has developed an 
electronic data system for col- 
lection of secondary voca- 
tional data at each individual 
school district. The depart- 
ment expects this system, the 
VEOS Micro-TURBO system, 
to be fully implemented at all 
districts by June 1993. Cur- 
rently, this system reports 
data for roughly 85 percent of 
all vocauonal enrollments. 
Once fully operational, the 
system will facilitate direct 
downloading to the state from 
each individual district. In 
the past, data have been 
passed along to the Career 
Education Planning District 
(CEPD) for editing and aggre- 
gation, then given to the state. 
The new system includes < 1) a 
statewide student-level record 
system. (2) vocational pro- 
gram files based upon course 
sections and CIP program 
classifications, and (3) a stu- 
dent-section linkage code to 
facilitate analysis of students 
in sections. 


Rhode Island has been able to 
operate on a system of paper 
documents because of its small 
size. However, it is planning to 
implement a computerized sys- 
tem in all the area vocational 
schools in the coming year or 
two. The current mode of infor- 
mation collecting is facilitated 
by the vocational counselors 
within each of the area schools. 
They are charged with meeting 
with students, filling out infor- 
mation, and and 
updating student vocational 
records. After information is 
collected, the student data 
sheets are passed along to the 
state MIS department for data 
entry. The system remains at 
the student record level even at 
the state. 


A recent study by the Na- 
tional Governors' Association 
found that a majority of states 
(twenty-sue of thirty-two sec- 
ondary agencies responding 
to the survey* have a central- 
ized vocational MIS system, 
generally indicating that a 
single automated entity re- 
ceives hard copy or electroni- 
cally tranamitted data from 
local education agencies 
(Amico. 19931. 


Kentucky counts students 
enrolled in both gainful and 
non-gainful programs. The 
state provides broad guide- 
lines for which programs 
should be counted in which 
category. For example, agri- 
culture production should 
be reported on the gainful 
roster, while agnsdence ex- 
ploration should be reported 
on the non-gainful roster all 
technical programs are sup- 
posed to be reported on the 
gainful roster. However, for 
business, the gainful/non- 
gainful assignment is sup- 
posed to be made according 
to student objectives rather 
than specific rinses. 


Michigan makes a distinction 
mitt student vocational enroll- 
ments between wage earning 
and non-wage earning. Basi- 
cally, wage earning describes 
all vocational programs other 
than consumer and home eco- 
nomics programs. Counting of 
student enrollments at each of 
these two separate levels is 
done differently. 


Virtually all vocational students 
take their courses at the area 
vocational schools, which are 
located within each school dis- 
trict {except for one school that 
is independent). Because Rhode 
Island has a very strict defini- 
tion of vocational programs, and 
because the state prefers all 
vocational programs to be of- 
fered at the area vocational 
schools, the regular academic 
schools usually do not apply 
for vocational status and fund- 
ing. All approved vocational 
programs must lead towards 
employment, meet certain cur- 
riculum standards, and be 
taught by a certified vocational 
Instructor . While the academic 
schools might offer courses gen* 
eraUy considered to be voca- 
tional, the data collected for 
these courses are not consid- 
ered to be vocational data. Thus, 
the only data for "gainful" pro- 
grams that are collected by 
Rhode Island are for those pro- 

frtni fiffor+H at t h ^ * res 

schools. A small portion of to- 
tal vocational students en- 
rolled at the area centers are 
adults, who take courses in 
the evening (sometmes dur- 
ing the day). Data regarding 
adults are collected through a 
separate system. 


i 
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Information on gainful 
courses and students is 
available in individual stu- 
dent record form. Thus, at 
thestamievet whether at the 
Depanmentof Education, the 
Board of Higher Education, 
or at Kentucky Tech. student 
enrollment data can be 
unnupoauedbyprogiamand 
across programs. Aggregate 
dam are collected by program 
on non-gainful courses and 
students. Thus, undupllcated 
counts are available only for 
enrollment within programs, 
not across programs 


Michigan is able to provide to- 
tal undupUcatcd counts of stu- 
dents enrolled within wage 
earning and non-wage earning 
programs, but where students 
are enrolled in both types of 
programs >H»*»»»»a»piv»«i/^ 
within wage earnmg. students 
are counted in only one pro- 
gram per year, even if they are 
enrolled in multiple programs, 
the criteria for determining 
which program will be reported 
are as follows: ether (1) the 
most recent vocational course 
enrolled to: or (2) if enrolled at 
the same ome. che course with 
more contact hours, if all is 
equal, the student should be 
assumed to a program by a 
school admttHatrator. Also 
within wage earning, distinc- 
tions are made betwem ninth 
and tenth grade enrollments, 
and eleventh and twelfth grade 
arrrollmenri within non-wage 
earning, all students are 
counted in the same category 
and assigned to the same pro- 
gram. Home Economics 
20.0101. 


Rhode island is able to provide 
uncHxpucated counts of all sec- 
ondary vocational students en- 
rolled at its vocational centers 
by program and CIP codes. 
Theoretically, its system should 
provide undupucated counts 
on a current basis, because 
information is continuously up- 
dated throughout the year on 
various forms. Three sets of 
forms provide similar informa- 
tion for stuotatenroUments in 
vocational programs by age. 
race-*thnictty. grade, and spe- 
cial needs, including handi- 
capped, limited English profi- 
cient, academically disadvan- 
taged, and economically disad- 
vantaged (only one may bedes- 
ignated as the primary special 
need). Also, codes are used to 
determine the scnooi. commu- 
nity, and kientmcanon of the 
student. Progiam mfca mautai 
is included regarding matricu- 
lation date, and hours/day and 
days/week spent in the voca- 
tional program. One form is 
used to assess all new incom- 
ing students at the 
of a program. The second farm 
is used to assess all returning 
students, and to update their 
personal information. The last 
form is used to update status 
changes of all vocational stu- 
dents, including program 
completion, transfers out of the 
program, drop-outs, and move- 
ment out of the community. 
The conglomeration of the data 
from these three forms pro- 
vides the universe of ail stu- 
dent enrollments in vocational 
education programs. 

tn practice, it is probable that 
the updates are not absolutely 
current because the local 
school and sate MIS director 
indicated that there was not 
enough time, resources, or in- 
centive for the schools to keep 
updating files throughout the 
year. 

Ataikvocaoonal educaaon rtsrs 
are collected completely sepa- 
rate from the traditional sec- 
ondary vocational education 
data. Total aggregate undup- 
llcated student counts and 
duplicated counts of the ven- 
ous special needs populations 
served are produced by these 
couecuona of adult data. 
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3. Ability to provide 
duplicated and 
undtxplicated 
counts of 
students 

b. by demographic 
group and special 
population status 


ROC/Ps report to CVE the 
number of mates and female*, 
broken down by race-^thnicity. 
who are enroiledtacach course, 
as well as the totai numoer of 
disadvantaged (eronocxuraiJy or 

and limited E«g<t«h proficient 
(LEW students la each course. 
However, as stated above, these 
enroiiment data produce pe~ 
tenttair/ duplicated counts of 
students when aggregated 
across courses. Oxmcyy district 
CBEDS forms report the total 
number of male and female 
students who are enrolled in 
vocational education, broken 
down by rsce-<thnictty . How- 
ever, no mformanon is avail- 
able on special populations in 
vocational education. Faculty 
report the number of male and 
female students enrolled in 
each of their courses, although 
these data produce duplicated 
rnrnllmcntcountawhcnaggre* 
gated across courses. 


Once the special population 
information has o<ct collected, 
undupttcattd counts of special 
population ^wrfhw^ wtOttn 
progi ania and among piugtaina 
can be extracted Cram the 
student record database The 
difficulty encountered la not to 
the use and quality of the data, 
but to the ideritiflcatlon of spe- 
cial population students, the 
available data are fine, but the 1 
procOemUea to the information 
that was not collected. Special 
population status la service 
driven: if students seek ser- 
vices (ilrected at special popu- 
lations, then they are labeled 
aa such: if they do not seek 
special services, then they are 
not identified as such. 


in spectfc labor market pro- 
grams, undimttcated enroll- 
ment la reported by race- 
ethnlctty by sex. Additionally. 

sojdents | *^**^y"gHthpm- 
ftdent «hih— son disad- 
vantaged etudems. Also there 
are separate counts of enrou- 
osemm grades 9. 10. 11. and 
12. For general labor market 
programs, enrollment la re- 
ported separately by sex. Ap- 
parently, there are no local 
counts of single parents or 
displaced homemakers. 


4. SHwi»ti*« included 
in enrollment 
counts 


Only those high school stu- 
dents attending an ROC/P 
course for twenty hours or more 
in a given year are included in 
the enrollment counts reported 
to CVE. the CBEDS count of 
students enrolled in vocational 
education tn councy/dismct 
schools and programs includes 
ail students In grades seven 
through twelve. 


All high school students that 
are enrolled in an occupation- 
ally specific vocational course 
are included in the rnrolhnrnT 

count. 


Secondary counts include all 
students in grades 9-12. 
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Kentucky can aggregate and 
re-aggregate data on gauuul 
students by their special 
population status because of 
the state's ability to sort by 
individual student record. 
However* nnf| *fli a<n>,t f prryarn 
counts of special populations 
are undupUcated within type 
and program, but are dupli- 
cated between types of spe- 
cial populations and among 
programs* 



Michigan reports undupUcated 
numbers of wage earning stu- 
dent enrollments (at all grades) 
and completions (eleventh and 
twelfth graders) by program, 
by race-ethniclty. and gender. 
Also. Michigan is able to report 
undupUcated counts of ninth 
and tenth, and eleventh and 
twelfth graders enrolled in the 
ricci-wayearnmgciasamcation 
by race~ethn*cttyand by gender. 
In this same report. Michigan 
collects total counts of stu- 
dents of the following types: 
handicapped, limited English 
proficient (LEP). and adults. 
However, these are not collected 
by program type, and dupuca- 
tton can result from one stu- 
dent having multiple special 
characteristics, in the new 
VEDS system (implemented 
within two years), new fields 
will be included to assess 
undupUcated counts of aca- 
demically disadvantaged, 
handicapped, single parents 
and displaced homemakers. 
LEP students, and criminal of 
fi 



The state is able to provide 
total undupUcated counts of 
**N*¥*ify ,tif ^ wt% *' M i Mi y 
by some demographic charac- 
teristics, but only duplicated 
counts by other characteris- 
tics. Regarding gender, race- 
ethnicity, and age. the state 
can provide undupUcated 
counts by program. However, 
in regards to the special popu- 
lations, (academically and 
economically disadvantaged. 

and llnttted En- 



glish proflciend. onrydupUcated 
counts can be given, because 
each student may be isaignrrt 
to multiple special needs. No 
information ts collected m the 
three forms regarding single 
parents and displaced home- 
makers, or correctional tadtt- 
ttea. Currently. Rhode Island 
does not collect such data, but 
plans to m the future. 



Given the capabilities of an 
Integrated individual student 
record system at the state 
level, vocational enrollment 
counts can be aggregated in 
many different ways. In 
counting secondary voca- 
tional students. Kentucky 
currently considers second- 
ary students in poatsecondary 
vocational programs as sec- 
ondary students, and counts 
them as such. 



Counts of enrollments and 
completions in vocational pro- 
grams induoe counts of atypi- 
cal students. For example, 
adults are included in counts 
of eleventh and twelfth grade 
enrollments and completions, 
Also, secondary students that 
areertroUedmapostsecondary 
program are counted by the 
district that receives the reim- 
bursement for the program 
And. in cases where students 
are enrolled in vocational pro* 
grams withm other districts, 
there are specific mstnicttons 
to allow for the students to be 
counted onry once—where they 
are enrolled. 



This system is very dear, de- 
fined, and straightforward. As 
a consequerce. there ts no 
confusion about who is in- 
cluded in the enrollment 
counts of secondary voca- 
tional programs. Adults are 
excluded. Only those students 
enrolled In state recognized 
programs (those offered at 
area schools) are included. 
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Colorado 
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5. Timing of 
enrollment 
count and data 
collection 


ROC/P enrollment data are 
caOlted at the end of each school 
year for the entire year. In 
contrast. CBEOS enrollment 
data arc collected on thestate's 
Information Day. a, specified 
day tn October, and only all 
earoUmemdamarccnilertffd 


Dutxtcts have to report the 
data to the state in May: how- 
ever, the exact data collection 
dates are left to the discretion 
of the local districts. The gen- 
eral process seems to be that 
teachers askstuoents to com- 
plete a data collection form 
on the first day of each term: 
the *»arhf t then have the 
responsibility for entering 
these data into the system by 
April, so that the districts can 
submit the tape or diskettes 
to the state by May. 


Uaduplicated counts are 
made after the start of each 
semester and are reported In 
February or March. 


6* Definition of 
program 
completers 


CVE drflnn cotor>leters as stu- 
dents who hsve met ROC/P 
course oojeenves. that is. they 
havescquired the skills deemed 
necessary for employment, and 
are no longer enrolled in the 
course. California secondary 
education does not define 
completion for those students 
parttctpating in vocational edu- 
cation outside of ROC/Ps. 


Secondary students who com- 
pleted a defined sequence of 
courses m occupational fy spe- 
cific programs approved by the 
itate are considered vocational 
cobspletets. 


At the secondary level, a pro- 
gram completer is defined as 
follows: (l) for agriculture, 
business, marketing, and 
trade and industry programs, 
a completer is one who has 
completed 75 percent of the 
total approved course se- 
quence: (2) !br health occupa- 
tions, a completer is one who 
has completed two semesters 
oftheheaith occupation pro- 
gram: 13) for occupational 

is one who has completed two 
semestei « * h^imtpiHiwi 
heme economics program; (4) 
for teen parenting, a compl- 
eter Is one who has partici- 
pated in the program and who 
haa graduated from high 
school, in at least one of the 
secondary districts we vis- 
ited, local officials said they 
could not accurately count 
program completers. 


7. Identification of 
special popula- 
tions 

a* Economically 
disadvantaged 


CVE defines disadvantaged 
students as those who have 
been identified as either eco- 
oomicsily or srsrtcmtraUy dls- 
sdrsnuujed by application of 

determined by the ROC/P. 
State suideUnss suggest that 
economically disadvantaged 
students be *^tmtwl based 
on psrocmenonm school lunch 
programs, work-study pro- 
grams, or famtfy participation 
iaAFDC 


Economically disadvantaged 
status is determined by eligi- 
bility for free or reduced-price 
lunch. 


Definition is derived from the 
Perkins regulations. 
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Enrollments are reported as 
ofOctober l. and are updated 
at the end of the year. 


UndupUcated enrollment and 
completion counts are taken 
once annually at the end of the 
academic year on June 30. 
Duplicated counts of enroll- 
ment are taken four times 
throughout the year, twice each 
semester. 


The forms for new and return- 
ing students must be completed 
and returned to the state de- 
parmaent by October 1. Butthe 
state reported that there is a 
strong tendency for schools to 
be late In submitting the forms. 
Reports are turned around and 
given back to the schools by 
mid-year. Theoretically, the 
student status change forms 
are supposed to be completed 
within one week of any change 
In a student's status in a pro- 
gram. However, as noted ear- 
lier, this usually does not oc- 
cur so promptly. 




The formal definition of a 
completer is a student who 
successfully completes a 
specified end "DOT* (Le.. set 
of competencies) m a gainful 
program. However, the school 
district visited mentioned that 
students who completed two 
yean of the vorattonsl pro- 
gram and graduated from mgh 
school were considered 
completers even if they did 
not attain the exit DOT. 


A program completer is some- 
one who (1) is an eleventh or 
twelfth grader (or adult). (2) is 
reported as enrolled In a voca- 
tional program (defined as a 
sequence of courses with aspe* 
dflc vocational goal), and (3) 
has completed the program ac- 
cording to the criteria of the 
local district 


Program completion is simply 
defined as succesartil comple- 
tion cl program cuxrtcuium and 
attainment of the occupational 
objective. Students are desig- 
nated as completers if \l) they 
fin out a change of program 
status fonninrticattngsucceas 
ful program completion, or (2) 
they graduate from high school 
while enrolled in a vocational 
school, which would usually 
signify program completion. 

The only discrepancy in this 
system would arise when stu- 
dents fulfill their high school 
graduation requirements, but 
do not fulfill their vocational 
objectives. In such cases, the 
schools should fill out a change 
of status form, indicating that 
the student has dropped out of 
the vocational program at 
graduation. However, it is pos- 
sible that some students are 
included in these completion 
counts, even if they did not 
fulfill their vocational objec- 
tives. 


A recent study by the Na- 
tional Governors Association 
found that the definition of 
program completers differs 
across states and across local 
education agencies within a 
state (Amfco. 1993). For ex- 
ample: (1) Alahsms defines a 
'program completer" as a stu- 
dent who finishes a planned 
sequence of courses, services, 
or activities designed to meet 
a vocational objective that 
teaches entry-level job skills, 
whether or not the student 
graduates: (2) Georgia defines 
a "program completer' as any 
student who graduates and 
has taken at least three differ- 
ent courses in a single voca- 
tional program area: and (3) 
the District of Columbia de- 
fines a "program completer" 
as a student who has finished 
all of the required skills and 
met all of the levels of compe- 
tencies in a program result- 
ing in receipt of a vocational 
program certificate. 


Economically disadvantaged 
students are determined by 
eUglblUry for free and reduced- 
price lunch. 




Economic disadvantages are 
defined by the state in two dif- 
ferent ways. 

1. The state usesone definl- 
oc«for allocating Perkins funds 
to the local education agencies 
(LEAa). This formula* which 
would not be divulged to us by 

UK HUB 1 UltKCi UKl UIC UC 

ceanial census data and ad- 
justs it annually to reflect the 
number of AFDCrectpienta. the 
neglected and delinquent 
counts, and the foster child 
counts by county, 
foonttnued an pope ill 
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(7a— continued) 



b. Academically 
diaadrantaged 



As stated above. CVE defines 
disadvantaged students as 
those who have been identified 
as either econonucairy or aca- 
demically disadvantaged by 
application of recognized 
screening criteria determined 
by the ROC/P. State gtr ie- 
Unes suggest that academically 
disadvantaged students be 
Id rn titled based on enrollment 
in remedial programs, student 
performance below grade level, 
poorp uform a nce onstandard* 
ized tests, or student failure of 
a grade. 



Academically disadvantaged 
students are defined as those 
who rank at the bottom 23 
percent of their class. 



Definition is derived from the 
Perkins 



c. Limited English 
proficient 



CVE defines IE? students as 
those belonging to a national 
ortgto minority group that does 
not speak or understand the 
English language. This lack of 
understanding affects course 
participation. 



IE? students are identified as 
such if they are in a program 
for IE? students. CCCOES of- 
ficially defines LEP students 
as those who do "not speak and 
understand the English lan* 
guage in an instructional set* 
ting weU enough to benefit from 
the instruction and cannot 
complete the objectives of the 
program without special assis- 
tance/ 



Definition is derived from the 
Perkins regulations. 



Handicapped/ 
disabled 



CVE defines handicapped 
students as those with health 
impairments or learning dis- 
abilities requiring special as- 
sistance or matenais for course 
participation. The state re- 
quires that students be certi- 
fied as handicapped under the 
guidelines for special educa* 



Handicapped/disabled stu 
dents are broken down into 
eleven categories and identi- 
fied as such If they receive spe- 
cial education services for then* 
specific needs. 



Definition is de ri ved from the 
Perkins regulations. 
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2. In filling out their voca- 
tional student forms, the 
schools are supposed to count 
students as economically dis- 
advantaged if they (1) have a 
family income below the pov- 
erty line. (2) are eligible for a 
free lunch. (3) are eligible for 
AFDC (4) rtcetve Pell or a com- 
parable grant, or (5) are eligible 
for funds under Title U of the 
Job Training Partnership Act 
(JTPA). 



Academically disadvantaged 
status used to be determined 
by California Test of Basic 
Skills (CIBO scores to read- 
ing and math: however, start- 
ing last year, academically 
disadvantaged status is 
being determined through 
student portfolios and per- 
formance testing. 



Any one or more of the follow- 
tog criteria o^tenmne academi- 
cally disadvantaged status: 
GPA below i.5 on a 4.0 scale 
for aU courses the previous yean 
scot below the 25th percentile 

on an a pntliri* teat? ^nmilm»nr 

to an artemaove education pro- 
gram the previous year: or drop- 
out or identified as a potential 
dropout. 



Any student who scored below 
the fiftieth percenoie on s stan- 
dardized aptitude test, whose 
secondary GPA is below a 2.0 
on a 4.0 scale, orwho has tailed 
to achieve basic academic com- 
petencies. is considered aca- 
demically disadvantaged. 



L£P students are determined 
by self- Identification or upon 
the receipt of LEP services. 



Vocational education students 
who may experience difficulty 
performing class activities and 
assignments in the English lan- 
guage because their nauve 
tongue is a language other than 
English are designated as LEP 
students. 



Students are considered LEP if 
(1) English is not their first 
language. 121 they came from 
an environment where English 
was not dominant, or (3) they 
scored below the allowable cut- 
off for standardized tests of 
English proficiency. 



Handicapped /disabled status 
is determined by self -identifi- 
cation, referrals from outside 
agencies, and/or upon the 
request for special handi- 
capped /disabled services. The 
Fayette County School Dis- 
trict works off a Department 
of Student Services list of 
students that have been 
tested and s creened during 
elementary school, and as- 
sessed sa havuig some level of 
exceptionality. 



To be served as handicapped, 
a student must be enrolled In 
a special education program 
leading to a high school di- 
ploma, and must have an indi- 
vidualized educauonai plan 
prescribed by an IEPC. 



Students with a vanety of con- 
ditions that will limit their 
success in regular vocational 
programs are defined as handi- 
capped/disabled. Students can 
have multiple disabilities. 
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e. Single parents 
mad displaced 
homemalceni 


Neither CVE nor California sec- 
ondary education defines the 
term. 


Students who receive services 
for single parents and displaced 
homemakers (for example, 
pregnant teens or teen moth- 
ers! are identified through 
service delivery. Several state 
agenaea (Department of Social 
Services, Department of Health. 
CCCOES. Department of Labor, 
and the Job Training Partner- 
ship Act UTPA!) share the same 
intake form for teen parents 
and suigie parent and displaced 

data for services provided by 
these state agencies are uni- 
form throughout all programs. 




8. Followup 
procedures 


ROC/Fs survey their program 
completers during the Janu- 
ary following the end of the 
relevant academic year. Some 
ROC/Ps also survey their pro* 
gram leavers, that is. those 
students who terminated en- 
rollment without meeting 
course objectives or achieving 
empioyabUity. Follow-up sta- 
tus counts are reported for each 
ROC/P course. Although in- 
formation is collected tor both 
high school and adult students, 
follow-up status is not reported 
separately for these groups. 


Up unal the 1991-92 school 
year, follow-up data were 
collected on all secondary 
program completers and non- 
completers of occupaoonally 
specific courses. Starting in 
1991-92. only graduates will 
be followed up. Graduates are 
followed up between six to eight 
months after program comple- 
tion (between November and 
February of the year following 
graduation!. Mainly teachers 
call graduates to gain follow* 
up information. 


At the secondary level, follow- 
up is done by the lead instruc- 
tors the vccanonal programs 
of agriculture, business, 
health, marketing, occupa- 
tional home economics, teen 
parenting, and trade and in- 
dustry. Follow-up reflects stu- 
dent status as of December/ 
January of the year following 
graduation from high school. 
Follow-up is limited to pro- 
gram completers. Instructors 
report the status of students 
in the following categories: 
military, employed (related or 
not related to training), pur- 
suing additional education 
(vocational or academic!, seek- 
ing employment, not tn the 
labor force, unknown, and de- 
ceased. Instructors are tree to 
do follow-up in whatever man- 
ner they choose. Most use the 
mail first and then follow-up 
by telephone. Response rates 
appear to be rather *ood — 70 
percent or better. There are 
no systematic surveys of em- 
ployers. 
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Rhode island does not collect 
data regarding single parents 
and displaced homemakers. or 
correctional facilities. Rhode 
Island expects to collect this 
Information in the future. 




Completers are followed up 
six months after they gradu- 
ate. Local school districts are 
given the latitude to follow up 
in any manner they choose. 
The school district visited has 
teachers conduct a telephone 
follow-up of gainful graduates 
in January. Kentucky Techs 
area vocational schools have 
a uniform six-month follow- 
up survey that instructors ad* 
minister. 


Follow-ups are conducted by 
the local school district within 
a period not greater than rune 
months following graduation 
(between February and April). 
Surveys can be conducted by 
mail or phone, and in the fu- 
ture the VEDS system can be 
used to facilitate automatic 
phone connections. The state 
provides a sample follow-up 
format, but the districts may 
use their own format, as long 
as they include the necessary 
state fields. On average, a re- 
sponse rate of 76 percent is 
attained. Follow-ups are con* 
ducted each year for the follow- 
ing types of program completers 
only: (l) those twelfth grade 
and adult students completing 
a program in the preceding year 
and (2) those eleventh grade 
students completing a program 
two years pnor. Employer fol- 
low-ups are not conducted. 
Additionally, the state offers to 
analyse the data of any district 
that wishes to do foUow-up on 
non-vocational student 
completers. 


Follow-up is conducted for se- 
niors six months after they 
graduate rromavocanonai pro- 
gram. No foUow-ups are con- 
ducted for students who com- 
pleted their vocational program 
before graduation. Each Indi- 
vidual school is responsible for 
conducting the follow-up. Al- 
though schools generally use 
the mad approach, it is recog- 
nized as ineffective, and re- 
sponse rates are only about 
twenty-few percent. Response 
forms are sent to students by 
the schools with a return enve- 
lope addressed to the state, 
where data is entered and ana- 
lyzed. Optional questions are 
included to assess the former 
students' employers, and their 
attitudes about the students' 
training. 


A recent study by the National 
Governors' Association found 
that in most states (eighteen 
of thirty secondary agencies 
responding to the surveyi pro- 
gram foUowup is decentral- 
ized, being conducted by local 
education agencies (Amico. 
1993). 
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9. Faculty 
Information 



CVE annually collects infor- 
mation on the number of cent* 



Teacher data are maundy col- 
lected through an automated 



The state can identify voca- 
tional instructors. 



fled and classified stall in each dataay stem Teache rs are Ktett* 
ROC/P. Including adnunistra- ofled as vocations! or academic 
tors, teachers, pupil services on the basis of their creden- 
personnel. paraproiessionals. gala 
office and clerical staff, and 
other classified staff. Each 
ROC/P r epo rt s the number of 
full-time (counted as individu- 
als) and part-time (counted as 
ftiU-tmie equivalent (FTE1) staff 
in each category, as wett as the 
number of males and females 
by their race-ethnicity. ROC/ 
Pa report all staff employed di- 
rectly or through contracted 
agreements with participating 
counnes or school districts, in 
turn. CBEOS requires that 
counties /districts report the 
number of classified staff, by 
classified category, full- and 
part-time status, gender, and 
race-ethnicity. Counties/dis- 
tricts also provide information 
on teacher shortage and de- 
mand, based on the number 
of emergency credentials or 
waivers allowed, the number of 
vacant positions, and the ex- 
pected number of hirees for 
each subject area. In addition, 
all certified staff members are 
required to provide informa- 
tion on their teaching and /or 
non-teaching assignments (in- 
cluding the number of students 
in e. cn courset. gender and 
race-e throaty, highest educa- 
tion level, number of years of 
professional educauonai ser- 
vice, tenurestatus. ruil- or pan - 
Brae status, and type ot teach- 
ing credential. Since certified 
staff report ail their assignments, 
including any contractual ar- 
rangements with ROC /Pa. these 
CBEOS data overlap with the 
annual CVE certified staff 
counts, without any simple 
means of undupUcating the 
lalormaoon. 
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The State Department of 
Education collects data on ail 
professional staff and teach* 
era within the department. 
This includes vocational 
teachers tn secondary schools 
and instructors at locally run 
area vocational centers. In* 
formation on Kentucky Tech's 
faculty, that la. instructors at 
the state-operated area voca- 
tional centers, is not uniformly 
collected. Data on faculty 
would have to be obtained 
directly from the personnel 
files kept at the state level. 


Teacher infarmancnu collected 
and kept wtth the Teacher Cer- 
tification Unit, a separate 
branch of the Department of 
Education. Districts must re- 
port teachers' social security 
numbers for each vocational 
course section offered. The 
teacher tnfarmaaon can be 
accessed through this link be- 
tween the courses and teacher 
records. The secondary voca- 
tional educational branch can 
access faculty records regard- 
ing fT^fli-atton, training, and 
other personal data through 
the use of the social security 
number* 


Since the number of schools in 
Rhode Island offering voca- 
tional programs (area voca- 
tional schools) is so few. the 
data collected on the instruc- 
tors are kept on file in hard 
copy at the state department. 
The system is so small that the 
state director has direct knowl- 
edge of most instructors. The 
following instructor informa- 
tion is kept on file: programs 
taught by faculty, instructor 
certification, work experience 
in the field, and special qualifi- 
cations. 
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1. Status of data 
automation 


In the past vocational educa- 
tion data at the postsecondary 
level were collected through the 
California Community College 
(CCC1 system's automated Vo- 
cational Student Data System 
(V5DSI. A minority of CCC dis- 
tricts submitted their VSDS 
data on hard copy. However, 
because of the use of Oat files, 
and the use of a VSDS-spccuic 
student identifier rather than 
social security number, there 
was no way to link the voca- 
tional data to other data collec- 
tion efforts. Currently, the state 
is phasing in an integrated 
Management information Sys- 
tem (MIS) for all postsecondaxy 
education in the CCC system, 
including vocational and 
nortvocational education, and 
relying on social security num- 
bers as student identifiers. 
However, a few CCC districts 
a till do not gather social secu- 
rity numbers. The MIS will 
generate all reports to federal 
agencies, the state legislature, 
and to local institutions. 


Colorado has an automated, 
integrated, individual student 
record data system that in- 
cludes both secondary and 
postsecondary tnformstion 


Idaho Oocs not maintain stu- 
dent record systems at the 
state level. Local postsecond- 
ary agencies report data to 
the State 0 (vision of Voca- 
tional Education on paper 
forms. These are thraentered 
into the states data system, 
which maintains aggregate 
data on each agency. At the 
local level, ail of the campuses 
appear to have automated 
student records, although the 
systems differ among sites. A 
state-level* automated post- 
secondary student record 
system is planned for the 
1993-44 academic year but 


2. Levels of 
vocational 
ccrarsetaking 


For s number of years, the CCC 
system has used a state-devel- 
oped Student Accountability 
Model (SAM) for **«i«fHtrTg a 
vocational major to a student. 
Institutions assign one of the 
following SAM codes to each vo- 
cational course they offer A, ap- 
prenticeship: B. advanced occu- 
panonai: C. clearly occunanonai: 
D. possibly occupanonai: £. 
nonoccupational but offered in 
an occupational oepanmenc F. 
conaumoarmhomcmalongedu- 
caflntraaMccupatamaii: aswett 
asO.all other and.X. unknown. 
A student s major is generally 
detcrmmed to be the program 
area of the highest SAM-coded 
course m which the student en- 
rolled during the acsdemtc year. 
However, the SAM also details a 
decision tree for asagrang the 
appropriate major tn more cora- 
pkacassa In the annual perfor- 
mance report to OVAEU CCC 
provides two figures for voca- 
tional program enrollment: first, 
a tatty of att students with SAM 
codes Borland second, a tally 
of aU students with SAM codes D 
or F. CCC also provides enroil- 
mants to anprertcfceshtp (SAM 
codtnl. m addition. CCC counts 
rnrrgjleuous for students with 
SAJ£ codes B or C and for stu- 


Colorado counts only the stu- 
dents pursuing a vocational 
program, that is. those who 
were enrolled tn at least six 
semester hours of a vocational 
program during a single se- 
mester. 


At the postsecondary level, 
there is no distinction between 
specific and general labor 
market programs. AU report- 
ing is done bv suc-diglt code 
(see below). 
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Kentucky has an automated 
individual student record sys- 
tem at the state level for gain- 
ful students. Records are 
computerized at the commu- 
nity colleges and universities. 
Movement towards automa- 
tion is occurring within the 
Kentucky Tech system (en- 
compassing the state-run 
secondary area vocational 
centers and the postsecond- 
ary vocational-technical 
schools). Four of the Ken- 
tucky Tech sites have been 
computerized as pan of a pi- 
lot program. At these pilot 
sites, student data is entered 
Into the cn-Une system at the 
local school. 


Michigan has an automated ' 
data system called the CIS 
[Computer-Based Telecommu- 
nications System), which fa- 
cilitates the passage of student 
data, including vocational data, 
from the community colleges 
to the state. Each school col- 
lects and stores the informa- 
tion at the school through a 
computer driven student-level 
record system, based upon a 
school identification number. 
The information is then passed 
along to the state through the 
CIS in aggregate form. 


The state of Rhode Island is 
unique in that it has only one 
community college, which is 
extended to multiple campuses 
The school has a computerized 
student-level data collection 
system that it uses for its own 
programming purposes. How- 
ever, the state does not have a 
computerized postsecondary 
vocational data system. The 
state receives only school-level 
data reports that are submit- 
ted on federal 1PEDS forms. 


A recent study by the National 
Governors' Association found 
that a majority of states (rune 
of fourteen postsecondary 
agencies responding to the 
survey) have a centralized 
vocational MIS system, gen- 
erally indicating that a single 
automated entity receives 
hard copy or electronically 
transmitted data from local 
institutions (Amlco. 1993). 


Kentucky counts students 
enrolled in both gainful and 
non-gainful programs. Within 
the Kentucky Tech system, 
this distinction is dependent 
upon the length of the pro- 
gram in which a student is 
enrolled. Programs of 500 
hours or more are considered 
gainful programs, while pro- 
grams of less than 500 hours 
are considered non-gainful 
programs. The community 
colleges and four-year uni- 
versities make the gainful/ 
non-gainful determination 
using students' majors and 
the programs in which they 
are enrolled. 


Michigan has established dif- 
ferences among the various 
types of students enrolled at 
the postsecondary level based 
upon their academic orienta- 
tion. Three types of students 
exist: ill students enrolled in 
credit courses seeking a formal 
degree/ award (that is. a pro- 
gram): (2) students enrolled in 
credit courses not seeking a 
formal degree/award: and (3) 
students enrolled in non-credit 
courses. Student enrollment 
data are collected according to 
these classifications. 


The state does not provide a 
dear definition for postsecond- 
ary vocational students. For 
policy reasons, the school has 
tried not to classify students 
into vocational tracks. There- 
fore, the school can only iden- 
tify vocational students by a 
process of eliminating those 
students not enrolled in a spe- 
oncaltv academic or transfer 
program. The school maintains 
course and program data that 
could be used to further iden- 
tify vocational students, but it 
cannot do so because it lacks a 
definition to classify vocational 
students. 
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duplicated and 
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counts 

a. of all students 



California 



Because of its detailed SAM 
decision tree and its student 
recced system, the CCC system 
ts able to provide undupiicated 
counts of students enrolled to, 
and completing specific voca- 
tional programs. However. CCC 
uses a state-developed Tax* 
onomy of Programs (TOPI to 
classify its vocauonal pro* 
grams, rather than the NCES- 
developed Classification of 
Instructional Programs (CtP). 
Although the TOP has been 
cross-walked to the CB>. some 
discrepancies between the 
systems exist, at least at the 
margins. For example, while 
some TOP programs are con- 
sidered vocational by the state, 
their CXP equivalents are not. 
Furthermore, some courses in 
CXP vocational program areas 
are considered by the state (and 
are coded tn TOP) as transferor 
nonvocanonai courses. 



Colorado 



Colorado has a student r e co rd 
data system at the state level, 
thus has the flexibility to ag- 
gregate and re-aggregate the 
data to provide undupucated 
enrollment counts of students 
both wtthtn programs and 
among programs. Programs arc 
dennedatthes«-<UgitClPlevei 
and students are assigned to 
programs based on their course 
enrollment However, in cases 
where the student is enrolled 
tn more than one program area, 
the state uses an algorithm 
that assigns the student to one 
program only. 



Idaho 



Institutions r epor t undunll* i 
caxed head counts by six-digit 
CXP code. These counts are 
reported by race-ethnictty by 
sex Additionally, counts of 
handicapped students, stu- 
dents with limited English 
proficiency, and disadvan- 
taged students are also 
provided. Pos secondary in- 
stitutions also rep o rt total 
student contact hours by six- 
digit program code. 



b. by demographic 
group and 
special popula- 
tion status 



The old VSDS collected infor- 
mation on the instructional 
setting of Perkins 1 special 
populations. During the tran- 
sition from VSDS to MIS. CCC 
implemented an interim col- 
lection of the new Perkins U 
special populations. The fullv 
implemented MIS will be able 
to produce undupiicated 
counts of these groups. 



Once the special population 
Information has been collected, 
undupucated counts of special 
population enrollment within 
programs and among pt ogi aras 
can be extracted from the 
student record database The 
difficulty encountered ts not in 
the use and quality of the data, 
but in the identification of 
special population students. 
The available data are tine, but 
the problem lies tn the infor- 
mation that was not collected. 
Special population status ts 
service driven: u students seek 
services directed at special 
populations, then they are la- 
beled as such: if they do not 
seek special services, then they 
are not identified as such. 
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Information on gainful 
courses and students is avail- 
able in individual student 
record form. Thus, at the state 
level, whether at the Depart- 
ment of Education, the Board 
of Higher Education, or at 
Kentucky Tech. student en- 
rollment data can be undu- 
plicated by program and 
across programs. Aggregate 
data are collected by program 
on non-gainful courses and 
students. Thus, undupttcated 
counts are available only for 
enrollment within programs, 
not across programs. 



Michigan bases program en- 
rollment counts upon the in- 
tentions that students declare 
to complete a certain degree/ 
award. Michigan can provide 
total undupUcated counts of 
student program enrollments 
across all programs. Students 
who are not seeking a formal 
degree/award are not included 
in the program enrollment 
counts. Students can not be 
duplicated in more than one 
program, because they can only 
seek one degree. For data col- 
lection purposes, the state de- 
panment designates each pro- 
gram that the schools offer by a 
comparable CIP code. Also, for 
funding purposes. Michigan 
collects information about 
teaching contact hours by pro- 
gram. However, these data are 
aggregated, meaning that it is 
not possible to getstudent head 
counts or to determine the types 
of students served by demo- 
graphic characteristics. 



The IPEDS surveys include the 
Call enroiirnent survey of ail stu- 
dents and the biannual survey 
of enrollments in occupation- 
air/ specific certificate pro- 
grams. The Community College 
of Rhode Island (CCRX1 does 
have student-level course 
enrollment data, but because 
the school has not denned 
vocational courses, it is not 
able to provide vocational 
course enrollment counts. 



Kentucky can aggregate and 
re* aggregate data on gainful 
students by their special 
population status because of 
the state's ability to sort by 
individual student record. 
However, non-gainful program 
counts of special populations 
are undupUcated within type 
and program, but are dupli- 
cated betw e e n types of spe- 
cial populations and among 
programs. 



Michigan collect* two types of 
enrollment data. The first type 
Is mil enrollment data, which 
are aggregate totals of all 
students enrolled at the com- 
munity colleges during count 
day in the fall semester. These 
data are collected by part-time 
and full-time designations: by 
student classification levels (for 
example, degree seeking): and 
by race-ethruaty. gender, age. 
residence status, handicapped 
status, and age, No mforrnsoon 
reganmtg program enrollments 
are included in these counts. 
The second type of enrollment 
data is year end enrollment, 
collected by program and by 
race-e thru city, genoer. age. 
handicapped, and residence 
status. Data on other students 
(single parents and displaced 
riomemakers. limited English 
proficient (LEP). acsdemically 
and economically disadvan- 
taged, and corrections* are 
collected by the ?tate through 
rnsndatory final reports, and 
areaucUted by the state through 
on-site evaluation visits . These 
special reports must be com- 
pleted by any school receiving 
federal funds for vocational 
education. 



Student demographic data are 
collected and can be merged 
with the student course flies 
using the students' social se- 
ctary nurnbers. However. COB 
does not usually merge and 
analyze these data because of 

From these data, duplicated 
course enrollments could be 
broken down by race, gender. 
hgtyfl f^pped. and ya r** fT, T a| fy ' 
and economically disadvan- 
taged. 
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4. Students included 
in enrollment 
counts 


MIS Induces ail students en- 
rolling in at least one census 
class or attending sx least one 
postave attendance das*, that 
is. open entry/ exit courses, 
such as baste skills. 


To be included in the count of 
vocational students, a student 
must be enrolled for at least 
six semester hours in a single 
vocational program in the se- 
mester being surveyed. Those 
students with less than six 
semester hours are counted 
in the vocational full-time 
equivalent (FTE1. but not as a 
vocational student. Students 
can only be enrolled in one 
program: when students are 
identified as being enrolled in 
two programs, they are ran- 
domly assigned at the state 
level to a single program. 


Pcatsecondarycounotnciude 
full- time and part-time stu- 
dents. 


5* Timing of 
enrollment 
count and data 
collection 


Enrollment counts are taken 
during one of two censuses for 
dally or weekly census classes, 
and the data are reported to 
the state at the end of term. 
However, some local admlnis* 
trators complained that the 
fourth week census did not 
count enrollments during the 
second nine-week term or for 
some positive attendance 
classes. Some also complained 
that summer courses were not 
counted. 


Data collection occurs during 
the last semester of the aca- 
dame year for the two previous 
semesters. Data to the state for 
Perkins reporting are due be- 
fore the final student data are 
complete (the spring semester 
is sou in session). However, the 
final audit, due to the Colorado 
Council on Higher Education 
on Jury 15. contains the com- 
plete enrollment data of the 
previous academic year. This 
final enrollment database be- 
comes the master database 
from which all others are cut 
and that provides the informa- 
tion for all audits. 


The count is made on the 
tenth instructional day of each 
8-week session. 


6. Definition of 
program 
completers 


Under VSDS. CCC Identified a 
program completer as either a 
student with a SAM code of B 
or C who recerved an associate 
degree or program certificate, 
or a student with a SAM code of 
B who completed a B -level 
course. Under MIS. successful 
completion was assumed if the 
student reached a B-level 
course. 


Completers are identified by 
award of a vocational degree t<r 
certificate. 


A completer u *a student who 
finished s planned vrpimrr 
of courses, services, or aenvt- 
ties designed to meet a voca- 
tional occupational objective. 
This person must have met 
all the requirements of the 
institution for program 
completion, whether or not 
the person graduated from 
the institution.* Officials 
questioned the accuracy of 
completer counts. 
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Enrollment counts generally 
includcallvocattonai students 
registered and enroUed in aU 
levels of postsecondary pro- 
grams, whether certificate or 
degree programs. However, 
secondary students taking 
postsecondary courses at a 
Kentucky Tech vocational 
technical school are not 
considered posts econdary 
students in the annual per* 
formance report but are 
considered posts econdary 
students in IPEDS reporting. 


founts of program enrollmem 
ire very difficult to interpret for 
two reasons. First, adrntnutra- 
jOts are retted upon to determine 
and update students' progam 
intentions. Undoubtedly, there 
is much discrepancy between 
students' declarations and 
actual program completions. 
Second, students who go on to 
four-year universities might be 
counted for enrollment in a 
vocational program and receive 
the training, even though they 
will be transferring on to con- 
tinue their education. Because 


Hearty, there is a lack of accu- 
racy in reporting vocational 
enrollments. Becnusesnidents 
are designated as vocational by 
a process of eitmtnsnon many 
non-vocational students may 
be included in this count and 
vice versa. 




of these inconsistencies, pro- 
gram enrollments are not 
clearly defined until gradua- 
tion (completion), when pro- 
gram designation is contained. 


For the programs under Ken- 
tucky Tech. enrollments are 
reported as of October I. In 
the university system, all in- 
stitutions icpoii enrollments 
as of five days after the start of 
the semester. 


Count day for fall enrollment 
collection is either the tenth 
day of class, or after one-tenth 
of the fall term has passed. 
Count day for year end enroll- 
ment is at the termination of 
the academic year (after June 
30). 


Vocational enrollment counts 
are collected btannuaUy. as re- 
quired by the federal IPEDS 
data collections. 




At Kentucky Tech's voca- 
tional-technical schools, a 
completer is defined aa a 
recipient of a certificate or 
diploma in a long-term 
program (a program of 500 
or more hours). At the com- 
munity colleges and univer- 
sities, vocational students 
who receive their associate 
degrees are completers. 


Students are considered 
completers if they have satis- 
fied all the requirements for a 
one- or two-year occupational 
education program (and the 
award is actually conferred). 


The general definition of a pro- 
gram completer is a student 
who receives a certificate or 
associate degree. However, 
school ofllciala were concerned 
with this stringent deflmtion. 
because only about ten per- 
cent of all students graduate 
wtth a formal degree. 


A recent study by the National 
Governors' Association found 
that the definition of program 
completers differs across 
states and across local insti- 
tutions within a state (Annco. 
1993). For exempts (U mtneas 
defines a * program completer 
as a student who conipktrs 
a sequence of courses to 
acquire academic and occu- 
pational competence and 
receives a certificate or asso* 
elate degree: (2) Texas defines 

student who completes a 
Doard sppxoicdikjyoeorccr- 
tificstemtcclmsftjtf education; 
and (3) Washington defines 
several levels of "program 
coefloktars.' indurtlng course 
completers with varying 
amounts of credits earned: 
degree completers: and cer- 

lng amounta of tratntng. 
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7. Identification, of 
special popula- 
tions 

a. Economically 
disadvantaged 


The state recexved& waiver from 
Peridns requirements to count 
luecooouaicmily disadvantaged 
students based on whether a 
student quatfws tor 
aid rather than reeeues Ann* 
daiatd. Determmauon is based 

Mfi Opt] fnnfi ind ?H» ■(•>*'■ 

Basle Education Opportunity 
Grants (tuition relief) or other 
similar finanoai aid. 


Students are considered eco- 
nomically disadvantaged if 
they have family incomes at 
or betow the poverty tine. This 
information comes from the 
student financial aid form. 


See the definition under 
secondary education. 




b. Academically 
disadvantaged 


The SAM manual subtests 
identifying acadenucalty dis~ 
advantaged students based on 

qonorp^acmrmonararteTTTtc 
probaootL Individual institu- 
tions choose which method to 
use. 


Entering students are deter- 
mined to be academically 
cUsadvantaged if they do not 
perform up to a certain level 
on the SAT/ACT or on the 
entry assessment instru- 
ments (students who did not 
take the SAT/ACT are as- 
sessed upon entry). Enrolled 
students are considered aca- 
demically disadvantaged If 
they are performing below 
grade level and have been 
referred to. or have sought 
special services. 


See the definition under 
secondary education. 




c* Limited English 
proficient 


State-kvel administrators be* 
Ueved that some inantuoons 
defined an LEP student as any 
student who took an R.ST. class. 
However, the srimtnistrators 
were not sure whether ail tnati- 
tuttons denned this population 
in the same way. 


LEP students are identified 
as such if they seek LEP ser- 
vices provided by the commu- 
nity colleges, the Colorado 
Community College and Oc- 
cupational Education System 
(CCCOES) officially defines 
LEP students aa those who do 
*not speak and understand 
the English language in an 
instructional setting well 
enough to benefit from the 
instruction and cannot com- 

program without special as* 
slstancc/ 

l 


See the definition under 
secondary education. 
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Students who receive Pell 
grants and/or who report 
that their income tails below 
federal poverty lines are 
considered economically dis- 
advantaged. Students are 
identified through financial 
and intake forms from the 
assessment and learning cen- 
ters. These two forms may not 
capture the enure universe of 
economically disadvantaged 
students. 



Economically disadvantaged 
students are defined as those 
who are from tamUiesrecervtrig 
financial assistance, or are 
migrants. 



(The primary source of data tor 
identifying special populations 
is service delivery. Forexuspic* 
if a student recei v es aid m 
mains tresming. or mobility 
assistance, the student would 
be classified as handicapped* 
Additionally, students may 
self -report their special needs* 
without receiving a particular 
service. Many problems arise i 
when icermfytng academically 
and economically disadvan- 
taged students. Because 
onuxy needy students do not 
ever receive services for their 
special needs, they are not 
included in data coUecuon.1 



At Kentucky Tech's voca- 
tional-technical schools. 
Test of Adult Basic Educa- 
tion (TABE) scores are used 
to determine academically 
disadvantaged status. The 
community colleges and uni- 
versities may identify aca- 
demically disadvantaged 
students in different ways. 
At the community college 
visited, academically disad- 
vantaged students are those 
who were recommended for 
remedial work based on their 
placement testing. 



Students denned as academi- 
cally disadvantaged include 
those who are dropouts or po- 
tential dropouts from high 
school those who tested below 
the 25th percentile on a stan- 
dardized aptitude/ achieve- 
ment exam, those who had 
secondary grades tower than a 
2.0 GPA on a 4.0 scale, those 
who do not have minimum 
academic competencies or are 
carrying less than a 2.0 grade 
in an occupational program or 
job training course, those who 
have multiple withdrawals from 
prerequisites for occupational 
or job training, those who have 
been referred by faculty or staff 
as needing services in order to 
succeed, and those who have 
self-determmed the need for 
services in order to su cc ee d . 



Students in Kentucky Tech's 
vocational-technical schools 
are defined as LEP if they re- 
ceive special LEP services or if 
they self-reported LEP status 
on the student profile sheet, 
one of the enrollment intake 
forms. 



LEP individuals are defined 
by section 703 (a) (1) of the 
Elementary and Secondary 
Education Act of 1965. 
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d. Handicapped/ 
disabled 



Student disabilities must be 
vended through a state office. 
However, the state excludes 
psychological disabilities and 
substance abuse from the 
federal definition. State-Level 
administrators were not sure 
whether matttuoons included 
the two state-excluded dis- 
abilities in their definitions 
for vocational data reporting . 



Handicapped/disabled stu- 
dents are broken down into 
eleven categories and identi- 
fied only when they seek ser- 
vices for their disability. Even 
entering students who have 
been identified at the second- 
ary level as disabled are not 
counted at the postsecondary 
level as such. 



See the definition under 
secondary education. 



c. Single parents 
and displaced 
home makers 



State-level administrators 
stated that some institutions 
do not identify single parents. 
However, data were main- 
tained by the institutions 
for all participants in the 
New Horizons/ Sex Equity 
programs for single parents, 
displaced homemaicers. and 
non traditional students. 
Standard data were eoUected 
baaed on a state-developed 
P iog tai u Ae mtmrab di ty ModeL 



Unless a student seeks ser- 
vices for. and seif-kl entiflea as . 
a single parent, there is no 
identification of the student as 



See the definition under 
secondary education. 



such. 



8. Followup 
procedures 



CCC does not collect any ag- 
gregate follow-up data, instead, 
local instttuaons and districts 
determine whether to conduct 
a foUow-up survey. However. 
CCC did sponsor the develop- 
ment of a standard two-part 
s ur vey f orm that was first used 
m thesprmgof 1992. The class- 
room part of the survey was 
given to all advanced occupa- 
tional students Ithoae with SAM 
codes B and C) in the spring 
semester* and then the follow 
up part was sent to the same 
students sue months after they 
kft school 



Students are followed up ayear 
aitcrcompictmgtharprnysni. 
although this vanes soi 
because not all students finish 
their program at the sanv 
in the school year. The 
mumty colleges have a stan- 
dard foUow-up phone survey 
r formed by teachers. The 
commurutycoUegevtatted had 
appnnomatety a sixty to sixty 
five percent response rate. In 
addition an employer satisfac- 
tion aurvey is performed. 



The p r oce du re is similar to 
follow-up at the secondary 
level. However, at the poat- 
secondarylevetthefoUow-up 
damu recorded separately by 
race-ethnicity, special need, 
and type of award at comple- 
tion. 
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Hanalcapped/dissbled statue 
is determined by »df -Identifi- 
cation on intake forms, from 
outside agency referrals, and/ 
or upon the request for spe- 
cial handicapped/disabled 
services. 



Students considered to be 
andlcapped or disabled are 
those with a history ot physical 
or mental impairment limiting 
major life activities, or those 
deemed disabled according to 
part B of the Individuals with 
isablUties education Act, or 
those designated as disabled 
under section 504 of the Reha- 
bilitation Act of 1973. 



Slngie parent and displaced 
homemaker status is deter- 
mined by self-identification 
on the confidential entering 
student survey used by 
universities and community 
colleges, or on Kentucky 
Tech's vocational-technical 
schools intake form. 



An individual who is unmarried 
or legally separated and has cus- 
tody or joint custody of one or 
more children is * a 

single parent. Displaced home* 
makers tndude adults who have 
primarily worked without remu- 
neration caring tor the home and 
children and therefore have no 
marfcrtahlr skills, adults who 
have been reaant on public as- 
snce or £unily support no 
longer available, adults whose 
youngest child has reached the 
age that will make them aiett- 
glbte for AFDC and adults who 
are having troubles obtaining 
^ngitoyumiL 

For the most part. Michigan is 
able to provide up-to-date stu- 
dent de m ogr ap hic and speaal 
needs information because the 
te assesses these character- 
IsttcsatmstTiruiannrL However, 
ltm not dear if accurate informa- 
tion for first-year students re- 
garding LEP and disadvantaged 
status is available until aptitude 
tests are conducted. 



Completers and. if approved, 
their employers, are followed 
up six months after they 
graduate or complete their 
program. Completers in Ken- 
tucky Tech's vocational- 
technical schools are also 
followed up two years after 
completion. Postsecondary 
institutions (community col- 
leges and regional ummsm ea) 
used to conduct a two* and 
ft wy t ai fc ilow-upsntuiowoniy 
conduct a three-year follow* 
up. The community college 
visited is ^Mitng a five* 
and a ten-year follow-up on 
its 



FoUow-up reports are conducted 
by each school for students who 
graduated from their programs 
mthepreoaOngyear. Only those 
who graduated the year poor are 
surveyed. These reports must be 
submitted witfamnincmopthsof 



graduation. FoDow-upsarecon 
ducted by program by gender 
andrsce-ethrSctty. Schools may 
create their own survey format 
and hire out the work to an 
outside firm. The state does not 
requae that mipkj y us be sur- 
veyed. All vocational students 
receive the same survey. 

The community college visited 
conducts rnany other foilowHi ps 
for as own programnsng pur- 
posse* The school conducts foi- 
losMsps to assess aa success at 
trssmngsnd prepanng students 
far further 



Graduate follow-ups are con- 
ducted regarding employment 
experience and employer satis- 
faction for those srudenm that 
completed and received an as* 
socaate degree to the uiica t ea r, 
All other studenmareewtuded 



A recent study by the National 
Governors' Association found 
that in most states (seven of 
eleven postsecondary sgenoes 
responding to the survey) pro- 



including those students who 
received a certificate. CCRI re* 
ports sn average of eighty per 
cent response rate to this 
graduate survey. CCRI also 
conducts a foUow-up on nun 
returning students. Targeted 
students include those who 
were enrolled rail-time m the 
two prior semesters but did not 
return m the current year. The 
survey aaaessea students' rea 
sons for not returning. 



gram foUowup is decentral 
teed, being conducted by local 
Institutions tAmtco. 19931. 
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9. Faculty 
information 


VSOS did not coU<xt any* fee- 
uitrdata. to contrast. MIS can 
currently proauce a duplicated 
count of instructor* baaed ana 
count of vocational course sec- 
tions, in the future MIS ahouid 
be able to identify' Individual 
tnstructocs based on social se- 
cutter number* (or a unique 
dlstrtct-1 turned ldenaflerj. 
and be able to link them to 
couiaea and couzae sections. 


There is no comprehensive 
database on education fac- 
ulty at the poataecondary 

level. 


Poataecondary tnstltutiona 
use the (PEDS faculty survey. 

I 
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Postsecondary institutions 
under the University of Ken- 
tucky, which includes mil the 
community coUe^es. have just 
begun to unpiement a com- 
prehensive human resource 
system. This system makes 
no distinction between voca- 
tional and n on -vocational 
teachers. Faculty mfiormanon 
on Kentucky Tech's voca- 
tional-technical schools 
would need to be obtained 
directly from the personnel 
files kept at the state level. 



Michigan collects information 
on full-time Acuity through its 
annual Full-Time mstnxcuonsi 
Faculty Report. Iniormaoonu 
collected regarding the follow- 
ing: salaries, tenure, fringe 
benefits, contract length* sex. 
andacadenacrank. These data 
are collected on October 1 
each year. However, these are 
aggregate numbers regarding 
faculty, and are not broken 
down according to programs or 
departments. 



The college keeps computer" 
txed faculty data about creden- 
tlala. years ot experience at the 
college, and program te a chin g 
assignment by CIP code. Addi- 
tionally, the college maintains 
hard copies of resumes, work 
histories, contract in forma non. 
wagea. and other similar data. 
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Barbara Clements, Council of Chief State School Officers 
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Pat Dabs, National Center for Education Statistics 
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Bill Freund, National Center for Education Statistics 
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Sandra Furey, Office of Planning, Budget and Evaluation 

David Goodwin, Office of Planning, Budget and Evaluation 

Jeanne Griffith* National Center for Education Statistics 

Ron Hall, National Center for Education Statistics 

John Harris, Virginia Community College System 

Madeleine Hemmings, National Association of State Directors of Vocational Education 

Phyllis Herriage, National Center for Research in Vocational Education 

Chuck Hopkins, Oklahoma Department of Vocational-Technical Education 

Jim Houser, National Center for Education Statistics 

Bertha King r Office of Vocational and Adult Education 

Andy Kolstad, National Center for Education Statistics 

Brett Lovejoy, American Vocational Association 

David Mahlouf, Office of Special Education and Rehabilitation Services 

Jim McKenny, American Association of Community and Junior Colleges 

Michael Morton, National Association of State Councils on Vocational Education 

Juliette N. Lester, National Occupational Information Coordinating Committee 

Audrey Pendleton, Office of Planning, Budget and Evaluation 

Gary Phillips, National Center for Education Statistics 

Jim Pinchak, Ohio Department of Education 

Paul Planchon, National Center for Education Statistics 

Leonard Powell, New York State Department of Education 

John Ralph, National Center for Education Statistics 

Mike Rush, Idaho Division of Vocational Education 

Mark Schwartz, Office of Vocational and Adult Education 

Barry Stem, Office of Vocational and Adult Education 

David Stevens, University of Maryland 

Roseanne White, Technology Students Association 

John Wirt Department of Labor 

Jim Woods, National Occupational Information Coordinating Committee 
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Carol Kochhar, George Washington University 

Mark Schwartz. Office of Vocational and Adult Education, Department of Education 
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Robert Graham. National Vocational Agriculture Teachers Association 

Coleman Harris, National Future Farmers of America Organization 
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